ERIC 


DOCOHEHT  BESOME 


ED  195  339 


PS  Oil  BQS 


AOTHOE 
TITLE 


INSTITOTION 
SPONS  AGENCY 

POB  CATE 
CONTPACT 
NOTE 


PuopPr  Pichard:  And  Others 

Technical  Appendices  to  the  National  Day  Care  Study: 

Effects  Analyses,  Final  Peport  of  the  National  Day 

Care  Study,  Volume  TV-C, 

Abt  Associates^  Inc.r  Cambridge ^  Mass, 

Administration  for  Children^  Youth,  and  Families 

(DHEW),  Washington,  d,C, 

Oct  Bn 

105-' 4-1100 

553p,:   For  related  documents,  see  ED  131  928-930,  ED 
1U7  016,   ED   152   Mt*,   ED  160  IBS,  ED   168  706^   ED  16B 
733,  and  PS  Oil  £'46-8a9. 


EDPS  PPTCE 
DESCPIPTOPS 


IDENTIFIEPS 


ABSTPACT 


flF02/PC23  Plus  Pos^-age. 

Child  Caregivers:  c:-ssroom  Environment;  *Day  Care: 
Day  Care  Centers:  *Mt-^sures  (Individuals);  National 
surveys:  Observation:  -Policy  Formation;  Preschool 
Children:  *Pesearch  Methodology:  *Test  Pesults 
♦National  Day  Care  Study 


This  volume,  "Effects  Analyses,"  the  third  o 
Technical  Appendices  to  the  National  Day  Care  Study  (NDCS), 
in  six  individual  reports  the  results  of  analyses  investigat 
relationships  between  policy  variables,  classroom  processes 
cutcomes.  The  volume  begins  with  a  presentation  of  the  major 
analyses  based  on  the  two  behavioral  observation  instruments 
the  study  ("The  Adult  Focus  Observation"  and  "The  Child-Focu 
Observation"),  and  then  moves  to  a  detailed  treatment  of  the 
development  and  use  of  adiusted  test  score  gains.  Links  amon 
caregiver  and  child  behavior,  child  test  scores  and  other  de 
measures  are  explored,  Pesults  of  the  Atlanta  Public  School 
controlled  sybstudv  and  APS  replication  substudy  are  also 
(Author/MP) 


re 


f  three 
presents 
ing  the 
and  child 
effects 
used  in 


pendent 

(APS) 

ported. 


*  Peproductions  supplied  by  EDPS  are  the  best  that  can  be  made  * 

*  from  the  original  document.  * 

ERIC 


Pinal  Report  of  the 
VOLUME  IV-C 

October  1980 


ional  Day  Care  Study 


u  s.  OEPARTMENT  OF  HEALTH. 
EDUCATION  a  WELFARE 
NATIONAL  INSTITUTE  OF 
EDUCATION 

THIS  DOCUMENT  HAS  BEEN  REPRO- 
DUCED EXACTLY  AS  RECEIVED  FROM 
THE  PERSON  OR  ORGANIZATION  ORIGIN- 
ATING IT  POINTS  OF  VIEW  OR  OPINIONS 
STATED  DO  NOT  NECESSARILY  REPRE- 
SENTOFFICIAL  NATIONAL  INSTITUTEOF 
EDUCATION  POSITION  OR  POLICY 


TECHNICAL  APPENDICES 
TO  THE  NATIONAL 
DAY  CARE  STUDY 


EFFECTS  ANALYSES 


Papers  by: 

Barbara  Dillon  Goodson 
David  B.  Connell 
Robert  Goodrich 
Judith  D.  Singer 
Nancy  N.  Goodrich 


Prepared  for: 
Day  Care  Division 

Administration  for  Children,  Youth  and  Famili 
Office  of  Human  Development  Services 
Department  of  Health,  Education  and  Welfare 

Allen  N.  Smith,  Government  Project  Director 


Prepared  by: 


Abt  Associates  Inc.  ^ 
"SJ  ^   Cambridge,  Massachusetts 

Richard  Ruopp,  ^ 
National  Day  Care  Study  Director 

Jeffrey  Travers, 

Associate  Director  ' 

A 

Nancy  N.  Goodrich, 

Technical  Coordinator  ^ 


o 


Contract  No.  105-74-1100 


OVERVIEW  OF  NDCS  FINAL  REPORT  VOLUMES 

R«ults  of  the  NaUonal  Day  C.re  Study  and  its  major  supporting  rt.idy.  The  National  Day  Care  Supply  Study  is  orcsented  in 
•  five-volume  final  report.  Contents  of  these  vulumes  are  as  follows:  '     presented  in 


Volume  I 


fa^/hT  ""r^^T'"-'  ^""l""^  Finding,  and  Policy  Implications  oj  the  National  Day  Core  Study  otesenb  in  summar%- 
form  the  major  md.ngs  and  implications  for  federal  day  care  policy  of  the  National  Day  Care  S  a  fo™  s.udToTl^ 
fltotd  lL'r7h ^^""'f T  "■t'J"'J"y  and  «»'  of  day  care  for  preschoolers.  Vobme  se^S  a^  a  s^ 

contained  volume  for  the  po hey  makers  and  as  the  foundation  for  the  detailed  presentation  of  results  in  Volume  II  III  and 

Voiu™  n  "  '       '  °' "  Infant/Toddler  Study  are  included  rapi^idL  to 


Volume  II 


Hiuujra^  ana  results  ol  inc  INlA^  lor  the  technical  reader  who  seeks  a  more  thorough  understanding  nf  th^  «f.,r1v  fr«™  ^ 


Volume  lU 


^^u^l^t  ^  """J  "^^  °f      ""'""'J  Day  Care  Supply  Study,  is  based 

pj^nt  J  on  ctara^r^t^  Tt^l '      T  ''"^  SumTa^  i^o^atb^ 


Volume  IV 

^'^dJSl''^rthe1^^^  '"I"  \"  """P*"*"™  of  '^hnical  papers  supporting  the  most  import.nl 

S;;;^",^  L  folfot  thesummaries  in  Volumes  I  and  II.  NDCS  appendices  are  biund  in 

Mve^n"t«t  for  fh^^Nol^Tmer^t^^^^^  Background  Material,,  contains  three  papers,  each  of  which  establishes  a  distinc 
Snmrat- r  LTl,.  »         T  °"  °'  «'°"P       ""^  reg. datable  characteristics  of  the  dav  care 

a  ?^?w  ^?^MM  ^    J       ^      and  current  practice  of  day  care  in  the  three  NDCS  sites  (Atlanta.  Detroit.  Seattle); 

Vo lumHv  B  V       1°^*?.'     c"  i^'^''"' '°  f"""  ""^  Pe«P«ctive  of  black  social  scientists.  ' 

Volume  IV-B.  Mifiofw;  Day  Care  Study  Measurement  and  Methods,  pTesenls  individual  reports  on  a  serl«  of  technical 

iS'^Z'T^tefnat'e''""''"'"^^^ 

^is  of  alternative  measures  of  classroom  composition:  psychometric  analysis  of  the  NDCS  test  battery:  and  analyst  of 

S  ^iXeTtTk^dtt  pf  "7n  'I'V'"''^-  ^  P"^"'"* '"""^  °f  »  'P»'»l  survey^of  parents  ofTub- 

»I^rand  o™«am^ri^7«    ^     "  """'^  °'      ""P"'  °"  °'  characteristiL.  such  as  physical 

space  and  program  orientation,  and  econometric  analyses.  ljii}»i<.«< 

n«^!Z'n'V»K'  C<.«  S»i«^  E/^eet,  Analyces.  also  a  series  of  individual  technical  reports,  begins  with  a 

^tat  on  of  the  major  effects  analyses  based  on  the  two  behavioral  observation  instruments,  and  then  mov'es  to  a  drtlned 
^«  and  ^-^''"r"'  """^  °'  -djusted  test  score  gains.  The  links  among  caregiver  and  chiW  b^raviorchnd  tS 
ITb^Sd'lnf  ;^t&TJu"dy'"  ^  ''"""'^      '"""^         ^"""'^  ^"0°' 


Volume  V 


Do«imen»<,»«,n  and  Da  „  gives  a  brief  overview  of  NDCS  data  collection  instruments  and  data  files. 
L^iiUvft^  P  »^  ''"^"'ff  themselves,  including  interview  and  data  collection  forms,  observation  s>st^  aS 
\  "^"^^ .°'        dicUonaries;  these  de«ribe  every  variable  in  the  NDCS  analytic  data  files  PartC  or^ 
vldescodebooks  for  the  data  files.  Parts  B  and  C  are  available  on  computer  tapes,  which  are  readabrind^n^^^^^^^ 
computer  q^stems  Note  that  computer  tapes  are  avaUable  only  from  Abt  AssSates.  independent  ol  specific 

Copies  of  the  final  report  may  be  ordered  from: 

•    ^^:^Sr""'^°"^^  •    EXECUTIVE  SUMMARY,  volumes  MV 

SKfrm"al°i,^.l?mlS^^^^  ^^.^^^'^^0^^- 

^T^^'sT'  """"""       '^'""'^  A^in^on.'vA  22210 

,-  20024  .    EXECUTIVE  SUMMARY.  Volumes  I-V 

Abt  Associates  Inc. 
55  Wheeler  Street 
Cambridge.  MA  02138 

Earlier  NDCS  publications  avaUable  from  ERIC  (hard  copy  or  microfiche)  are- 

i<otional  Day  Care  Study  Pint  Annual  Report,  Volume  I:  An  Overview  of  the  Study  [order  number  ED  131  9281.  Volume 
11:  Phase  /Of ^number  ED  131  929],  and  Volume  III:  Information  ManagementZSoata  Coll^on  Su  tJZ 

[order  number  ED  131  930]  (Cambridge.  MA;  Abt  Associates.  1976).  ^^oiieaton  Systems 

^nHnnn!  Hnu  r"""^ ^/l^'l  Anntml  Report  [order  number  ED  147  016]  (Cambridge.  MA;  Abt  Associates.  1977). 
Ass^iata.  iS  ^'''""'~"y  Findings  and  their  Implications  [order  number  ED  152 114]  (Cambridge.  MA:  Abt 


PAPERS: 


The  Adult-Focus  Observation 
Effects  Analysis 
(1) 


The  Child-Focus  Observation 
Effects  Analysis 
(111) 


Analysis  of  Test  Score  Growth 
in  the  National  Day  care  Study 
(209)  ^ 


Classroom  Process-Child 
Outcome  Analyses 
(321) 


The  Atlanta  Public  Schools 
Day  Care  Experiment 
(397) 


The  Effects  of  Day  Care  in  Eight 
Atlanta  Public  Schools  Day  Care  Centers 
(433) 


4 


GLOSSARY 


This  glossary  is  intended  as  an  aid  to  the  reader. 
It  IS  not  an  exhaustive  dictionary  of  terminology  relevant 
to  the  study  or  practice  of  day  care,  but  rather  a  list  of 
terms  used  throughout  the  volume  which  may  be  unfamiliar  to 
the  reader  or  which  have  special  meanings  for  the  purposes 
of  the  National  Day  Care  Study. 

An  alphabetical  list  of  terms  enables  the  reader 
to  find  any  item  easily;  numbers  refer  to  the  location  of 
the  term  in  the  glossary  itself,  which  is  arranged  by 
subject  area  to  facilitate  understanding  of  terms  in  rela- 
tion to  each  other  and  in  the  context  of  this  study. 
Subject  areas  are: 


Classification  of  Day  Care  Services 
Children  and  Staff 
Classification  of  Day  Care  Centers 
NDCS  Independent  Variables 
NDCS  Dependent  Variables 
Statistical  Terminology 


Alphabetical  r^f  Tprm^i 


activity  subgroup  [42] 
aide  [17] 
auspices  [21,  25] 
background  variable  [46] 
caregiver  [13] 
caregiver/child  ratio  [44] 
caregiver  qualifications  [45] 
child  Outcome  [51] 
classroom  composition  [33] 
classroom  process  [49] 
core  care  [8] 
correlation  [59] 
cost  variables  [54] 
day  care  [1] 
day  care  center  [2] 
dependent  variable  [47] 
developmental  outcomes  [52] 
effects  [48] 


family  day  care  home  [3] 
PPP  center  [34] 
full-time  day  care  [6] 
funding  source  [30,33] 
generalizability  of  a 

measure  [57] 
generalizability  of  a 

sample  [58] 
group  center  [23] 
group  day  care  home  [4] 
independent  center  [22,26] 
independent  variable  [36] 
infant  [12] 
in-home  day  care  [5] 
lead  caregiver  [16] 
lead  teacher  [15] 
legal  status  [19] 
multiple  regression  [61] 
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non-FFP  center  [35] 
nonprofit  center  [24] 
number  of  caregivers  [39] 
outcome  [53] 
parent-fee 

part-time  day  care  [7] 
policy  variable  [37] 
preschooler  [10] 
principal  components 


provider  [18] 
public  center  [29] 
publicly  funded  center  [32] 
regression  [60] 
reliability  [56] 
sponsored  center  [27] 
staff  [14] 

staff/child  ratio  [43] 
staffing  pattern  [40] 
supplemental  services  [9] 
toddler  [11] 
validity  [55] 


analysis  [62] 
private  center  [28] 
process  [50] 
profit  center  [20] 


Classification  of  Day  Care  Services 


Day  Care  [1]   is  defined  as  care  provided  to  a 


child  by  a  person  or  persons  outside  the  child's  immediate 
family,  either  inside  or  outside  the  child's  home. 


•    A  day  care  center  [2]   is  defined  as  a  licensed 
facility  in  which  care  is  provided  to  13  or 
more  children  under  the  age  of  13,  generally 
for  up  to  12  hours  each  day,  five  or  more  days 
each  week,  on  a  year-round  basis. 


•    The  term  family  day  care  home  [3]  refers  to  a 
private  family  home,  generally  not  licensed,  in 
which  children  receive  care,  usually  for  up  to 
12  hours  each  day,  five  or  more  days  each  week, 
on  a  year-round  basis.     Most  state  licensing 
codes  limit  family  day  care  homes  to  a  maximum 
of  six  children. 


•    A  group  day  care  home  [4]   is  defined  as  a  private 
home  serving  7  to  13  children,  with  one  or  two 
adults. 


•    In-home  day  care  [5]   is  defined  as  care  provided 
to  a  child  in  the  child's  own  home  by  a  nonrela- 
tive  or  by  a  relative  who  is  not  a  member  of 
the  child's  immediate  family. 
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VIII 


Day  care  of  any  of  these  types  may  be  either 
full-time  or  part-time* 

•  ^ull-time  day  care  [6]   is  defined  as  care  for 
30  or  more  hours  per  week. 

•  Part-time  day  care  {?]   is  defined  as  care  for 
less  than  30  hours  per  week. 

The  services  provided  by  a  day  care  center  may  be 
classified  into  two  blocks. 

•  Care  care  [8]  refers  to  the  common  components 
Of  the  daily  experience  of  all  children  in  day 
care  centers.     Core  care  includes  provision  of 
meals ^  snacks^  space  and  educational/play 
materials,  arrangements  for  minimum  health 
care,  and  various  caregiver  services  necessary 
to  the  nurturance  of  young  children. 


•    Supplemental  services  [9]  are  those  services  to 
children  and  their  families  provided  by  a  day 
care  center  in  addition  to  core  care.  For 
children,  such  services  include  transportation, 
diagnostic  testing  and  referrals.     For  parents, 
examples  are  social,  welfare  and  employment 
services,  and  parent  involvement  in  advisory 
and  decisionmaking  capacities.  Supplemental 
services  often  address  fundamental  needs;  the 
term    supplemental"  merely  reflects  the  fact 
that  they  are  outside  the  scope  of  a  minimal 
center  day  care  program. 


Children  and  staff 


The  following  terms  are  applied  to  children  and  adult 


in  day  care  settings. 


Preschoolers  [10]  are  defined  as  children 
three,  four  and  five  years  of  age  (36-71  months), 
in  some  states  most  five-year-olds  attend 
kindergarten  and  thus  are  considered  school-aged 
Children.     In  these  cases,  preschoolers  are 
predominantly  36  through  59  months  of  age. 
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•  Toddlers  [11]   are  defined  as  children  aged  18 
through  35  months  of  age, 

•  Infants  [12]  are  defined  as  children  from  birth 
through  17  months  of  age, 

•  A  caregiver  [13]   is  a  person  who  provides  direct 
care  to  children  in  a  day  care  center  classroom, 
a  family  day  care  home,  or  in  a  child's  own 
home.     Unless  otherwise  specified,  the  terms 
caregiver  and  staff  [14]  are  interchangeable  in 
NDCS  documents, 

•  A  lead  teacher  [15]    (or  lead  caregiver  [16])  is 
the  principally  responsible  caregiver  in  a  day 
care  classroom.     The  term  "teacher"  is  not 
intended  to  connote  a  school-like  atmosphere  in 
the  day  care  center.     The  term  caregiver  has 
been  used  to  refer  to  persons  working  v/ith 
children  in  day  care  settings,  and  the  term 
lead  teacher  is  sometimes  used  to  distinguish 
the  principally  responsible  caregiver  in  a  day 
care  classroom  from  her  aides, 

•  An  aide  [17]   is  a  caregiver  who  assists  a  lead 
teacher  in  a  day  care  classroom, 

•  A  day  care  provider  [18]   is  a  person  who 
is  directly  or  indirectly  involved  in  the 
provision  of  day  care  services;  including 
caregivers,  center  directors  and  owners. 

Classification  of  Day  Care  Centers 

Day  care  centers  are  classified  according  to  legal 
status  [19]   as  profit  or  nonprofit, 

•  Profit  centers  [20]  are  further  classified 
according  to  auspices  [21  ]   as  independent 
centers  or  group  centers, 

— Independent  centers  [22]   are  not  part  of  a 
chain  of  day  care  centers, 

— Group  centers  [23]  belong  to  a  chain  (group) 
of  day  care  centers. 
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•    Nonprofit  center,s  (24]  are  classified  according 
to  auspices  [25]  as  independent  centers  or 
sponsored  centers. 

--Independent  centers  [26]  are  not  sponsored 
by  any  group  or  agency. 

—Sponsored  centprs  [27]  are  classified  as 
either  private  or  public,  according  to  the 
nature  of  the  sponsoring  agency. 

--Private  centers  [28]  are  sponsored  by  a 
P^^^f^'^f  agency,  such  as  a  church.  (Note 
tnat  all  profitmaking  centers,  as  well  as 
independent  nonprofit  centers,  are  neces- 
sarily private.) 

—Public  centers  [29]  are  sponsored  by  some 
government  ^agency,  such  as  a  city  school 
system  or  a"  county  welfare  department. 

in  addition  to  classification  by  legal  status  and 
auspices,  day  care  centers  may  be  classified  by  a  cross- 
cutting  typology  according  to  funding  source.  [30] 

•  Parent-fee  centers  [31]  derive  more  than  half 
Of  their  income  from  parent  fees. 

•  Publicly  funded  centers  [32]  derive  their 
funding  principally  from  government  subsidies 
and  gifts  and  contributions. 

Alternatively,  centers  may  be  classified  by  funding 
source  [33]  according  to  federal  financial  participation 
(PPP).     This  typology  was  used  in  Supply  study  analyses,  and 
the  reader  may  find  these  terms  used  when  Supply  study  data 
are  referred  to. 

•  An  FFP  center  [34]   is  defined  as  any  center 
child(rIJr^         or  more  federally  subsidized 

•  A  non-FFP  center  [35]   is  defined  as  a  center 
which  serves  no  federally  subsidized  children. 


NDCS  Independent  Variables 


NDCS  independent  variables  [36]  are  those  vari- 
ables whose  costs  and  effects  were  to  be  measured.  There 
are  two  types  of  independent  variables:  policy  variables 
and  background  variables. 

•    Policy  variables  [37]  are  those  characteristics 
of  day  care  centers  which  may  influence  the 
quality  and  cost  of  center  day  care  and  which 
are  or  can  be  affected  by  federal  policy.  The 
NDCS  was  concerned  with  two  major  classes  of 
policy  variables:  classroom  composition  and 
caregiver  qualifications: 

— Classroom  composition  [38]  describes  con- 
figurations of  caregivers  and  children  in  day 
care  classrooms .     Classroom  composition  is 
defined  by  three  variables.     (Note  that  any 
two  of  these  variables  mathematically  define 
the  third.) 

— Number  of  caregivers  [39]  is  defined  as  the 
total  number  of  caregivers  assigned  to  each 
classroom.  (The  term  staffing  pattern  [40] 
may  refer  not  only  to  the  number  of  care- 
givers assigned  to  a  classroom,  but  also  to 
the  mix  of  teachers  and  aides  or  to  the  mix 
of  qualifications  of  the  caregivers  in  a 
classroom. ] 

— Group  size  [41]   is  defined  as  the  total 
number  of  children  assigned  to  a  caregiver 
or  team  of  caregivers.     In  most  cases, 
groups  occupied  individual  classrooms  or 
well-defined  physical  spaces  within  larger 
rooms.     In  a  few  "open  classroom"  centers, 
children  were  free  to  move  from  group  to 
group.     In  such  cases,  clusters  of  children 
participating  .in  common  activities  under 
the  supervision  of  the  same  caregiver  or 
team  of  caregivers  were  considered  to  be 
"groups."     (The  term  activity  subgroup 
[42],  by  contrast,  refers  to  the  actual 
number  of  children  interacting  with  a 
particular  caregiver.     A  group  of  20 
children,  for  instance,  might  be  divided 
into  three  activity  subgroups,  one  with  the 
lead  teacher,  and  two  with  aides.) 
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— staff/child  ratio  [43]   is  defined  as 
number  of  caregivers  divided  by  group 
size.     Higher,  or  more  stringent,  staff/ 
child  ratios  are  those  with  a  smaller 
number  of  children  per  adult.  For 
instance,  a  ratio  of  1:5  is  higher,  or  more 
stringent,  that  a  ratio  of  1:10  (which  is 
lower,  or  less  stringent).     Note  that  the 
terms  staff/child  ratio  and  caregiver/child 
^^tio  [44]  are  interchangeable  in  NDCS 
discussions. 

—Caregiver  qualifications  [45]  variables 
were  developed  to  describe  caregivers' 
years  of  formal  education,  amount  of 
training  and/or  education  related  to  child 
development,  and  amount  of  work  experience 
as  a  caregiver. 

•  Background  variables  [46]  are  characteristics 
of  day  care  centers  which  can  be  influenced  by 
government  regulation  only  indirectly,  if  at 
all.     Examples  are  age,  sex  and  race  of  children, 
or  socio-economic  characteristics  of  families 
and  of  the  community  served  by  a  center. 

NDCS  Dependent  Variables 

NDCS  dependent  variables  [47]  are  those  features 
of  day  care  costs  and  quality  measured  as  indicators  of  the 
effects  of  such  center  characteristics  as  group  size, 
staff/child  ratio  and  caregiver  qualifications  (the  study's 
independent  variables). 

•  In  NDCS  discussions,  the  term  effects  [48]  is 
often  used  to  distinguish  dependent  variables 
pertaining  to  quality  in  day  care  from  dependent 
variables  pertaining  to  day  care  costs.  There 
are  two  major  classes  of  effects  variables. 

— The  term  classroom  process  [49]   (or  process 
[50])  refers  to  the  behavior  of  children  and 
caregivers  in  the  classroom;  that  is,  the 
dynamics  of  their  interaction.     Process  was 
recorded  using  two  observation  instruments, 
one  concentrating  on  children's  behaviors 
(the  Child-Focus  Instrument)  and  one  concen- 
trating on  caregivers'  behaviors  (the  Adult- 
Focus  Instrument). 
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— The  term  child  outcomes  [51]   (or  develop- 
mental outcomes  [52]^  or  outcomes  [53]) 
refers  to  children's  gains  in  school- 
readiness  skills;  although  a  number  of  tests 
and  ratings  of  social  and  cognitive  develop- 
ment were  field-tested,  ultimately  only  two, 
both  .-standardized  cogni'«:ive  tests,  proved 
reliabl-^  enouyh  to  be  used  as  outcome  measures: 
the  Preschool  Inventory  (PSI)  and  the  Peabody 
Picture  Vocabulary  Test  (PPVT). 

•  Cost  variables  [54]  correspond  in  the  main  to 
commonly  used  terminology  in  accounting  and 
economics,    where  terms  or  variables  peculiar 
to  the  NDCS  are  introduced,  they  are  explained 
m  the  text. 

Statistical  Terminology 

•  The  validity  [55]  of  a  measure  is  the  degree  to 
which  it  measures  what  it  purports  to  measure. 
Various  features  of  a  measure  may  be  indicative 
of  Its  validity;  such  as:   (1)  a  direct  conceptual 
relationship  between  the  measure  and  the 
construct  of  interest  (e.g.,  between  an  observer's 
count  of  the  number  of  children  present  in  a 
class  and  the  variable  group  size) ;  or  (2) 
agreement  with  other  measure:j  of  'the  same 
constiTuct  (e.g.,  agreement  between  observation- 
based  measiircmants  of  group  size  and  schedule- 
based  measurements  of  group  size) . 

•  The  reliability  [56]  of  a  measure  is  the  degree 
to  which  it  gives  consistent  results  when 
applied  in  a  variety  of  situations;  that  is, 
the  degree  to  which  it  is  free  of  measurement 
error.    Reliability  coefficients  vary  from  0.00 
to  1.00.    A  coefficient  of  0.00  indicates  a 
completely  unreliable  measure;  a  coefficient 

of  1.00  indicates  a  measure  that  gives  perfectly 
consistent  results  across  all  situations. 
Thus,  a  reliability  coefficient  of  .95  indicates 
that  95  percent  of  the  measured  variation  among 
the  objects  of  measurement  (e.g.,  among  children) 
IS  attributable  to  genuine  differences  among 
the  objects  of  measurement,  and  that  only  5 
percent  of  the  variation  measured  is  attributable 
to  random  effects  of  errors  of  measurement. 
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The  qeneralizabilitv  of  a  measure  [57]  is  a 
sophisticated  extension  of  the  concept  of 
reliability  in  psychological  measurement 
theory.     It  incorporates  the  notion  that  the 
numerous  sources  of  variation  in  measurement 
groups  as  "measurement  error"  according  to 
standard  reliability  theory  may  or  may  not  be 
defined  as  "error depending  on  one's  purpose 
in  using  a  given  measure.     [The  concept  of 
generalizability  is  a  very  complex  one  which 
cannot  be  clearly  presented  in  the  limited 
space  available  here.     For  a  definitive  treat- 
ment of  the  subject,  the  reader  is  referred  to 
L.  Cronbach,  G,  Gleser,  H.  Nanda,  and  N. 
Rajaratnam,  The  Dependability  of  Behavioral 
Measurements;    Theory  of  Generalizability  for 
Scores  and  Profiles  (New  York:  John  Wiley  & 
Sons,  Inc. ,  1972)  .] 

The  qeneralizabilitv  of  a  sample  [58]  is 
the  degree  to  which  the  sample  accurately 
represents  a  universe  to  which  findings  based 
on  the  sample  are  to  be  extended. 

The  correlation  [59]   (degree  of  association) 
between  two  variables  is  represented  by  a 
correlation  coefficient  expressed  as  a  decimal 
fraction.     Correlation  coefficients  range  from 
+1.00  (representing  a  perfect  positive  correla- 
tion) through  zero  (representing  the  absence  of 
any  correlation)  to  -1.00  (representing  a 
perfect  negative  correlation).     For  example,  a 
positive  correlation  between  children's  scores 
on  Tests  A  and  B  would  mean  that  children  with 
high  (or  low)  scores  on  Tests  A  also  tend  to 
have  high  (or  low)  scores  on  Test  B.     If  the 
two  tests'  scores  were  negatively  correlated, 
then  high  scores  on  Test  A  would  tend  to  be 
associated  with  low  scores  on  Test  B,  and  vice 
versa. 

Regression  [60]  analysis  is  a  be^niqu^  for 
extracting  from  data  an  idea>fzed  represen- 
tation, in  the  form  of  a  s^Traight  line,  of  the 
relationship  between  two  variables.    That  is, 
regression  defines  the  particular  straight  line 
which  is  the  "best"  linear  approximation  of  the 
less  clearcut  pattern  exhibited  in  the  data. 
Similarly,  multiple  regression  [61]  analysis 
extracts  an  idealized  representation  of  the 
relationships  between  a  given  dependent  vari- 
able and  two  or  more  independent  variables. 
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Regression  [60]  analysis  is  a  technique  for 
extracting  from  data  an  idealized  represen- 
tation, in  the  form  of  a  straight  line,  of  the 
relationship  between  two  variables.    That  is, 
regression  defines  the  particular  straight  line 
which  IS  the  "best"  linear  approximation  of  the 
less  clearcut  pattern  exhibited  in  the  data. 
Similarly,  multiple  regression  [61]  analysis 
extracts  an  idealized  representation  of  the 
relationships  between  a  given  dependent  vari- 
able and  two  or  more  independent  variables. 

Principal  components  analvsis...L621  produced 
alternative  weighted  combinations  of  variables 
(  principal  components"),  thus  allowing  the 
researcher  to  select  a  small  number  of  compon- 
ents which  convey  most  of  the  important  infor- 
mation in  a  data  set—that  is,  which  together 
account  for  a  large  proportion  of  the  variance 
m  the  data.     For  example,  a  large  number  of 
variables  related  to  socioeconomic  status  might 
be  reduced  to  a  few  components — clusters  of 
variables  which  are  highly  correlated  with  one 
another  and  only  weakly  related  to  variables  in 
other  components. 
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FOREWORD 


Providing  sound  research  which  supports  social 
policy  directions  affecting  the  lives  of  children  and 
families  is  unquestionably  a  major  goal  of  the  Administra- 
tion for  Children,  Youth  and  Families.     By  producing  a  clear 
signal  in  an  often  times  cloudy  environment,  we  are  able  to 
fulfill  this  important  responsibility  that  has  been  entrusted 
to  us. 


The  National  Day  Care  Study  (NDCS)  is  an  outstand- 
ing example  of  our  meeting  this  responsibility.     This  study 
has  been  widely  recognized  in  both  public  and  private 
sectors  as  one  of  the  most  important  social  policy  research 
investigations  ever  by  the  Department.     its  information  has 
been  widely  used  by  many  people  and  organizations,  and  it 
already  has  had  a  major  impact  on  the  drafting  of  the  new 
HHS  Day  Care  Regulations. 

The  NDCS  searched  for  day  care  center  characteris- 
tics which  can  both  protect  children  from  harm  as  well  as 
foster  their  social,  emotional  and  cognitive  development. 
It  discovered  that  these  outcomes  are  clearly  attainable 
when  groups  of  children  are  small  and  when  caregivers 
receive  training  in  child-related  areas.     it  also  found  that 
relaxing  the  staff/child  ratio  would  not  adversely  affect 
children  but  could  lower  costs  substantially  and  thus  enable 
more  children  to  receive  care.     That  these  findings  held  up 
across  diverse  sites  and  with  different  groups  of  children, 
provided  support  that  all  children  can  benefit  from  a  single 
set  of  standards. 

In  all,  I  feel  that  the  NDCS  has  more  than  justi- 
fied the  tremendous  energy  and  time  that  has  gone  into  it. 
Through  this  kind  of  commitment  to  excellence  in  its  research 
programs,  the  Administration  for  Children,  Youth  and  Families 
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can  be  an  instrumental  force  in  enhancing  the  well-being  of 
all  children  and  families. 

I  am  pleased  to  present  the  final  volumes  of  the 
study — Volumes  II  and  IV-A,  B  and  c.     Volume  II  is  the 
research  companion  to  Volume  I~"Children  at  the  Center." 
It  provides  quantitative  support  to  the  study's  major 
findings.     Volume  IV  is  a  compendium  of  technical  papers 
which  address  study-related  background  issues,  NDCS  measures 
and  methods  and  detailed  results  of  individual  outcome 
areas. 

Jack  Calhoun 

Commissioner,  Administration 
for  Children,  Youth  and  Families 

October,  1980 
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PREFACE 


The  federal  government  has  become  a  major  purchaser 
of  child  care,  chiefly  for  the  children  of  the  working  poor. 
With  the  growth  of  federal  expenditures  has  come  increased 
public  concern  about  the  quality  and  cost  of  care  purchased 
with  federal  dollars.     The  National  Day  Care  Study  (NDCS) 
addressed  this  dual  concern.     Commissioned  in  1974  by  the 
Office  of  Child  Development,*  the  study  was  conducted 
by  two  private  research  organizations — Abt  Associates  Inc. 
and  SRI  International.     The  study  concluded  that,  by  setting 
appropriate  purchasing  standards,  the  government  could  buy 
better  care  at  lower  cost  than  it  currently  buys,  thus 
allowing  it  to  serve  more  children  within  existing  budgets. 

Results  of  the  study  were  summarized  in  a  report 
published  in  March  1979.1    The  results  were  heavily  cited 
in  supporting  arguments  for  proposed  federal  regulations, 
which  were  published  in  the  Federal  Register  in  early 
1980.2 

The  present  volume  is  one  of  a  series  supplement- 
ing the  summary  report. 3     it  is  intended  to  provide  profes- 
sionals in  developmental  psychology  and  related  fields  with 
a  description  of  the  methods  and  findings  underlying  the 
study's  conclusions  about  links  between  regulatable  char- 
acteristics of  day  care  centers  and  the  experiences  and 
development  of  preschool  children  in  center  care. 

Policy  Context  of  the  NDCS 

Public  concern  with  the  quality  of  federally  sub- 
sidized child  care  is  embodied  in  the  Federal  Interagency 


The  Office  of  Child  Development  is  now  the  Administration 
for  Children,  Youth  and  Families  (ACYF) . 
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just  mentioned),  there  was  little  evidence  of  major  hetero- 
geneity that  might  suggest  that  the  effects  of  group  size 
are  site-specific.     Moreover,  there  was  no  clear  numerical 
point  of  demarcation  between  small,   "good"  groups  and  large, 
"bad"  ones.     Most  of  the  study's  centers  maintained  groups 
of  three-  and  four-year  olds  that  varied  in  size  from  12  to 
24;  typically,  desirable  behaviors  decreased  in  frequency  by 
roughly  20  percent,  and  pndesirable  behaviors  increased  by 
20  percent,   as  group  size  increased  within  this  range. 

Third,  staff/child  ratio  was  also  related  to 
some  aspects  of  interaction  in  the  classroom,  but  the 
correlates  of  this  critical  policy  variable,  the  focus  of 
much  of  the  controversy  surrounding  day  care  regulations, 
were  less  widespread  than  those  of  group  size.     Ratio  was 
most  clearly  related  to  caregiver  behavior:     lead  caregivers 
in  high-ratio  classes  (those  with  few  children  per  adult) 
showed  essentially  the  same  pattern  of  behavior  reported 
above  for  caregivers  in  small  groups.     (However,  the  con- 
founding of  ratio  and  group  size  for  the  lead  caregiver 
sample  made  it  unclear  whether  the  behavior  pattern  should 
be  attributed  to  ratio,  group  size  or  both.)     In  addition, 
lead  caregivers  in  high-ratio  classes  spent  less  time  in 
overt  management  of  children  than  those  in  low-ratio  classes. 
They  also  spent  more  time  interacting  with  other  adults  and 
in  other  activities  not  directly  involving  children.  Thus 
some  of  the  "contact  time"  potentially  available  to  children 
by  virtue  of  high  adult/child  ratios  was  spent  in  other 
ways.     High  ratios  were  not  associated  with  high  frequencies 
of  one-to-one  interaction  between  adults  and  children;  in 
fact,  ratio  showed  few  systematic  relationships  to  the 
behavior  of  children  at  all.     Nor  was  ratio  related  to 
children's  test  score  gains,  except  in  a  few  isolated 
instances . 
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Title  XX  PIDCR.     That  report,   issued  in  1978,  concluded 
that  federal  regulation  was  an  appropriate  means  of  main- 
taining quality  in  subsidized  care  but  that  the  existing 
PIDCP  were  in  need  of  revision. 5 

The  Office  of  Child  Development  (now  ACYP)  had 
initiated  the  NDCS  before  the  controversy  over  the  Title  XX 
PIDCR  erupted.     The  NDCS  and  the  Appropriateness  Report  were 
entirely  independent  efforts.     Nevertheless  the  authors  of 
the  Appropriateness  Report  made  heavy  use  of  early  results 
from  the  study,  incorporating  a  preliminary  report  of  NDCS 
findings  6  as  an  appendix  to  their  own  report.  Subse- 
quently, NDCS  staff  and  the  government  project  director  were 
consulted  during  the  drafting  of  revised  regulations,  which 
began  within  ACYP  and  was  completed  by  the  office  of  HEW* s 
General  Counsel.     The  influence  of  the  study  is  clearly 
visible  in  the  proposed  new  standards  regarding  caregiver 
qualifications  and  group  composition  (group  size,  and  staff/ 
child  ratio).     V?hile  the  proposed  standards  deviate  from  the 
specific  numerical  recommendations  regarding  ratio  and  group 
size  that  appeared  in  the  NDCS  1979  sunmiary  report,  basic 
principles  are  retained — notably  joint  regulation  of  ratio 
and  group  size,  with  increased  emphasis  on = the  latter — as 
are  many  detailed  suggestions  regarding  methods  of  monitoring 
and  enforcement. 


NDCS  Approsrh  and  Pindings;     An  Overview 

The  1968  PIDCR  were  based  on  the  advice  of  practi- 
tioners and  experts  in  fields  related  to  child  care,  as  well 
as  the  best  research  evidence  available  at  the  time.  How- 
ever,  in  1968  there  existed  only  limited  empirical  evidence 
to  support  the  basic  but  tacit  assumptions  that  link  various 
provisions  of  the  regulations  to  quality  of  care—for 
example,  the  assumption  that  maintaining  high  staff/child 
ratios  (few  children  per  caregiver)  will  increase  the 


XXI  Jf 


quantity  and  quality  of  adult-child  interaction.  Nor 
were  there  data  to  support  the  assumption  that  regulatory 
control  over  such  center  characteristics  as  staff/child 
ratio,  group  size  and  staff  qualifications  would  produce 
similar  outcomes  for  children  across  the  regions,  states, 
sponsoring  agencies  and  socioeconomic  groups  affected  by 
federal  legislation.     Similarly,  though  a  good  deal  was 
known  about  the  different  components  of  cost  in  day  care,  no 
specific  evidence  existed  to  link  costs  to  regulated  center 
characteristics  or  to  quality.     The  NDCS  attempted  to  fill 
these  gaps  in  knowledge  by  identifying  costs  and  effects 
associated  with  variations  in  center  characteristics  that 
were  regulated  or  could  potentially  be  regulated  by  the 
federal  government. 

The  study's  sponsors  and  designers  recognized  that 
national  policymakers  have  many  different  views  of  the  goals 
of  day  care.     For  example,   federally  subsidized  day  care  can 
be  seen  primarily  as  an  institution  designed  to  free  parents 
to  work  or  to  employ  welfare  recipients.     However,  ACYF  has 
long  been  committed  to  the  view  that  day  care  can  and  should 
foster  the  development  of  children.     Hence  the  study  focused 
on  the  quality  of  care  from  the  point  of  view  of  the  child — 
i.e.,  on  the  nature  of  the  child's  experience  in  day  care  and 
on  the  developmental  effects  of  that  experience,  as  measured 
by  naturalistic  observations  and  standardized  tests.  While 
many  potentially  regulatable  center  charcteristics  were 
examined,  primary  attention  focused  on  those  character- 
istics which  seemed  most  central  to  existing  regulations  and 
most  likely  to  affect  the  daily  experience  of  the  child, 
namely  staff /child  ratio,  group  size  and  staff  qualifications 

Perhaps  the  most  general  and  important  finding  of 
the  study  was  that  variations  in  regulatable  center  character 
istics  do  make  a  difference  in  the  well-being  of  children. 
In  contrast  to  many  earlier  studies  of  the  effects  of 
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variations  in  curriculum  or  resource  outlay  in  education, 
the  NDCS  showed  clearly  that  it  matters  how  day  care  classes 
are  arranged  and  who  staffs  them.     To  be  sure,  much  of  what 
goes  on  in  day  care  is  not  influenced  by  regulatable  center 
characteristics.     There  is  a  great  deal  of  variability  in 
the  quality  of  human  interaction  in  day  care  settings  even 
when  the  composition  of  the  classroom  and  the  qualifications 
of  caregivers  are  fixed.     Nevertheless  regulatable  character- 
istics show  relationships  to  meaures  of  children's  experience 
and  of  developmental  change  that  are  significant  both 
statistically  and  substantively. 

More  specifically,  for  preschool  children  (ages 
3-5),  the  smaller  the  group  in  which  children  are  placed, 
the  more  they  tend  to  engage  in  creative,  verbal/intellectual 
and  cooperative  activity.     Also,  children  in  small  groups 
make  more  rapid  gains  on  certain  standardized  tests  than  do 
their  peers  in  larger  groups,     when  groups  are  larger, 
individual  children  tend  to  "get  lost,"  i.e,,  to  wander 
aimlessly  and  to  be  uninvolved  in  the  ongoing  activity  of 
the  group.     These  findings  hold  even  when  staff/child  ratios 
are  relatively  high  (i,e,,  when  there  are  few  children  per 
caregiver),*    Adding  adults  (usually  teachers'  aides)  to  a 
large  group  of  children  improves  the  adult/child  ratio  but 
does  not  necessarily  result  in  increased  engagement  on  the 
part  of  the  child,  nor  improved  test  score  gains.  Signifi- 
cantly, children  do  not  appear  to  experience  more  one-to-one 
interaction  with  adults  when  ratios  are  high  than  when  they 
are  low. 


In  day  care  classrooms,  unlike  many  public  school  class- 
rooms, it  is  not  usual  to  find  a  single  adult  in  charge. 
Configurations  of  two  or  three  caregivers,  usually  a 
teacher  plus  aides,  are  more  common.     Both  the  number 
of  children  and  the  number  of  adults  varies  significantly 
from  classroom  to  classroom.     It  is  for  this  reason  that 
staff/ child  ratio  and  group  size  can  vary  more  or  less 
independently  and  must  be  examined  separately,     it  can- 
not simply  be  assumed  that  large  classes  will  have  low 
ratios  nor  that  small  classes  will  have  high  ratios. 
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The  behavior  of  caregivers  toward  children  is  also 
related  to  group  or  class  size,  but  it  is  related  to  the 
staff/ child  ratio  as  well.     In  small  classes  and/or  classes 
with  high  ratios  (few  children  per  caregiver),   staff  tend  to 
devote  their  attention  to  small  clusters  of  2-7  children, 
rather  than  to  large  clusters  of  13  or  more.     Staff  in  such 
classes  also  spend  less  time  observing  children  passively 
than  do  caregivers  in  large  classes  and/or  classes  with  low 
ratios.     In  addition,   the  staff/ child  ratio  shows  some 
relationships  to  caregiver  behavior  that  are  not  found  for 
group  size.     High  ratios  appear  to  make  management  of 
children  easier.     Also,   in  high-ratio  classes  adults  spend 
more  time  with  other  adults  and  in  activities  not  involving 
children,   such  as  performance  of  routine  chores.  This 
outcome  may  suggest  that  high  ratios  benefit  caregivers  by 
providing  contact  with  other  adults  and  time  to  do  necessary 
tasks,  but  it  also  suggests  one  reason  why  high  ratios  do 
not  appear  to  affect  the  amount  of  one-to-one  interaction 
between  caregivers  and  children:     in  high-ratio  classes  some 
of  the  time  potentially  available  for  children  is  diverted 
to  activities  in  which  children  are  not  directly  involved. 

On  balance,  NDCS  findings  suggest  that  the  impor- 
tance of  group  size  as  a  regulatory  device  for  influencing 
quality  in  child  care  may  have  been  underestimated  and  the 
importance  of  staff/ child  ratio  somewhat  overestimated. 
This  conclusion,  of  course,  is  not  an  argument  for  abandoning 
regulation  of  staff/child  ratio.     Not  only  did  ratio  show 
some  positive  effects,  but  the  range  of  ratios  examined  in 
the  NDCS  was  relatively  narrow  and  relatively  high.  (Most 
centers  in  the  study  maintained  classes  with  five  to  nine 
children  per  caregiver.)     This  range  was  chosen  to  illustrate 
effects  of  variations  in  ratio  between  levels  required  by 
the  FIDCR  and  levels  permitted  by  most  states.  Consequently, 
generalization  of  the  findings  to  levels  outside  the  range 
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established  by  current  regulatory  variations  is  unwarranted. 
Moreover,  a  subsidiary  study  of  center  care  for  children 
under  three  suggested  that  ratio  was  as  important  as  group 
size  in  influencing  quality  of  care  for  infants  and  toddlers. 
Thus,  while  the  findings  suggest  that  controlling  ratio 
alone  is  not  an  effective  regulatory  strategy,  they  also 
suggest  that  ratio  should  be  included  with  group  size  in 
regulations  governing  classroom  composition. 

In  addition  to  the  above  findings  on  group  compo- 
sition, the  NDCS  showed  that  qualifications  of  caregivers 
also  affect  quality  of  care.     While  years  of  formal  educa- 
tion, degrees  attained  and  years  of  experience  per  se  made 
no  discernible  difference  in  quality  of  care,  those  care- 
givers who  had  education  or  training  specifically  related 
to  young  children  (e.g.,   in  early  childhood  education,  day 
care,  special  education  or  child  psychology)  provided  more 
social  and  intellectual  stimulation  to  children  in  their  care 
than  did  other  caregivers,  and  the  children  scored  higher  on 
standardized  tests. 

To  arrive  at  policy  recommendations,  these  find- 
ings were  integrated  with  results  from  other  components  of 
the  study  which  were  concerned  with  the  costs  associated 
with  the  various  regulatable  center  characteristics  and  with 
prevailing  practices  in  staffing  and  group  composition  among 
centers  nationally.     The  costs  of  maintaining  small  groups 
and  of  employing  staff  trained  or  educated  in  child-related 
fields  were  found  to  be  small,  whereas  the  costs  associated 
with  maintaining  high  staff /child  ratios  were  significant* 
Consequently  it  was  recommended  that,   for  preschoolers,  the 
group  size  standards  of  the  existing  FIDCR  be  maintained  or 
made  more  stringent,  while  the  ratio  requirements  be  relaxed 
slightly.     The  expected  result  would  be  an  improvement  in 
the  quality  of  care  for  preschoolers  together  with  a 
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reduction  in  costs  relative  to  those  that  would  prevail  if 
the  Title  XX  FIDCR  were  enforced.     Implementation  of  the 
NDCS  recommendations  would  not  require  major  disruption  of 
current  practice,  since  a  high  proportion  of  centers  nation- 
ally already  maintain  both  relatively  small  groups  and 
staff /child  ratios  that  are  only  a  little  less  stringent 
than  those  mandated  by  the  FIDCR,*  despite  claims  of  some 
providers  and  state  Title  XX  administrators  that  the  FIDCR 
ratios  are  unrealistically  strict. 7    For  infants  and 
toddlers,   institution  of  a  group  size  standard  and  maintenance 
of  the  current  ratio  standard  were  recommended.     It  was  also 
recommended  that  training  or  education  in  a  child-related 
field  be  required  of  all  individuals  providing  direct  care 
to  children,  and  that  states  be  required  to  make  such 
training  available. 

Organization  of  Technical  Appendices 

Technical  Appendices  to  the  National  Day  Care 
Study  are  divided  into  three  volumes.     Volume  IV-A,  Back- 
ground Materials,  contains  three  papers  that  help  to  set  a 
context  for  overall  study  results:     "Research  Issues  in  Day 
Care,  A  Focused  Review  of  the  Literature,"  "Case  Studies  of 
the  National  Day  Care  Study  Sites:     Atlanta,  Detroit  and 
Seattle,"  and  "The  National  Day  Care  Study  from  the  Pros- 
pective of  Black  Social  Scientists:  Reflections  on  Key 
Research  Issues."    Volume  IV-B  Measurement  and  Methods 
provides  seven  papers  that  describe  technical  tasks  under- 
taken to  support  the  effects  analyses  reported  in  Volume 
IV-C.     Included  are- papers  about  "Comparing  Alternative 
Measures  of  Classroom  Composition,"  "A  Psychometric  Analysis 
of  the  National  Day  Care  Study  Phase  III  child  Test  Battery," 

♦staff /child  ratios  nationwide,  averaging  over  all  classes 
and  ages  of  children,  are  1:6.8,  compared  to  1:6.3 
required  by  the  FIDCR,  and  1:12.5  permitted  by  state 
licensing  requirements. 8 
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"Investigation  of  Teacher  Rating  Scales  Considered  for  Use 
in  the  National  Day  Care  Study/*  "An  Analysis  of  the  CDA 
Checklist  Data,"  "Incerviews  with  Parents,"  "The  Classroom 
Environment  Study,"  and  "The  Econometric  Model." 

volume  iv-C,  Effects  Analyses,  presents  the 
results  of  analyses  that  investigated  relationships  between 
policy  variables,  classroom  processes  and  child  outcomes. 
Six  papers  are  included:     "The  Adult-Focus  Observation 
Effects  Analysis,"  "The  Child-Focus  Observation  Effects 
Analysis,"  "Analysis  of  Test  Score  Growth  in  the  National 
Day  Care  Study,"  "Classroom  Process-Child  Outcome  Analyses," 
"The  Atlanta  Public  Schools  Day  care  Experiment, "  and  "The 
Effects  of  Day  Care  in  Eight  Atlanta  Public  Schools  Day  care 
Centers."    All  of  the  papers  in  the  Technical  Appendices 
were  prepared  by  study  analysts  and  ware  the  basis  for 
findings  presented  in  Volumes  I  and  II. 
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CHAPTER  ONE;     INTRODUCTION  TO  THE  STUDY 


The  overall  objective  of  the  National  Day  Care 


Study  (NDCS)  was  to  provide  empirical  information  in  three 
areas  of  major  policy  concern:     (1)   the  quality  of  day  care 
provided,   (2)   the  per-child  cost  of  the  day  care  provided; 
and  (3)   the  potential  quality/cost  trade-offs  associated 
with  alternative  formulations  of  federal  day  care  regula- 
tions.    The  study  focused  on  the  largest  group  of  children 
receiving  federally  subsidized  care — preschool  children 
(aged  3-5) — and  on  the  day  care  settings  in  which  most  of 
these  children  are  found — urban  day  care  centers  serving 
low-income  families.     The  study  also  focused  on  program 
characcer ist ics  that  have  long  been  considered  key  deter- 
minants of  quality  and  cost  in  center  care — staff/child 
ratio,  group  size  and  caregiver  qualifications.     The  mandate 
of  the  NDCS  was  to  examine  the  impact  of  variations  in  these 
and  other  regulatable  characteristics  on  the  quality  and 
cost  of  care  received  by  preschool  children. 

The  NDCS  addressed  the  following  major  policy 

questions: 


•  How  is  the  daily  experience  and  consequent 
development  of  preschool  children  in  day  care 
centers  affected  by  variations  in  staff/child 
ratio,  group  size,  caregiver  qualifications  and 
other  regulatable  center  characteristics? 

•  How  is  the  per-child  cost  of  center-based  day 
care  affected  by  variations  in  staff/child 
ratio,  group  size,  caregiver  qualifications  and 
other  regulatable  center  characteristics? 

•  How  does  the  cost-effectiveness  of  center-based 
day  care  change  when  adjustments  are  made  in 
staff/child  ratio,  group  size,  caregiver 
qualifications  and  other  regulatable  center 
characteristics? 
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This  paper  presents  findings  relevant  to  the 
first-policy  question,  specifically,  how  is  caregiver 
behavior  in  day  care  centers  affected  by  variation^  in  the 
key  program  characteristics  (group  size,  ratio,  and  caregiver 
qualifications)  . 

Measuring  Caregiver  Behavior 

Caregiver  behavior  was  of  crucial  interest  in 
studying  quality  of  day  care  since,  for  the  children  in  a 
center,  the  caregiver  is  a  primary  determinant  of  their 
experience.    The  day-to-day  interaction  between  caregivers 
and  children,  and  the  caregiver's  methods  of  organizing  and 
managing  the  program,  are  the  central  mechanisms  by  which 
the  center  environment  influences  children's  learning  and 
development.     The  aspects  of  day  care  centers  that  are  key 
in  the  NDCS— group  size,  ratio,  and  caregiver  qualifications- 
are  presumed  to  be  linked  to  quality  of  care  precisely 
because  they  affect  the  nature  of  caregiver/child  inter- 
actions. 


Although  it  was  presumed  that  caregiver  behavior 
was  an  important  aspect  of  quality  in  day  care,  there  was  no 
established  theory  specifying  which  caregiver  behaviors 
promote  child  development  in  this  setting.     At  the  same 
time,  there  exists  a  wealth  of  research  findings  which  have 
at  least  potential  application  to  study  of  caregiver  behavior 
in  day  care  settings.     Selection  of  the  types  of  caregiver 
behavior  to  be  studied  in  the  NDCS  was  based,  in  part,  on 
data  from  four  broad  areas  of  research:     studies  of  how 
caregiver  behavior  is  related  to  center  characteristics; 
research  on  adult  (particularly  parent)  behavior  which 
promotes  child  development;  research  on  teacher  effective- 
ness with  children  in  early  grade  school;  and  descriptions 
of  day  care  environments.     The  existing  studies,  largely 
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based  on  settings  other  than  day  care,  point  to  the  import- 
ance of  certain  general  dimensions  of  adult  behavior  that 
may  be  relevant  for  day  care  as  well.     For  example,  investi- 
gations of  elementary  school  teaching  suggest  that  "warmth" 
and  "planfulness"  are  related  to  student  effort,  achievement, 
creativity  and  interest  in  school.     Studies  of  parent-child 
interaction  suggest  that  development  of  intellectual  skills 
is  associated  with  a  range  of  parental  behaviors,  socializa- 
tion practices,  and  aspects  of  the  emotional  climate  of  the 
home.     Included  among  these  are  frequent  conversational 
interchange,  especially  contingent  verbal  exchanges,  read- 
ing to  the  child,  and  encouragement  of  the  child's  autonomy 
and  participation  in  decision-making. 

The  available  research  thus  suggested  both  macro- 
variables  describing  patterns  of  interaction  (proportion  of 
time  interacting  with  various  size  groups)  as  well  as  quali- 
ties of  interaction  (e.g.,  warmth),  and  micro-variables  such 
as  contingent  verbal  response,  and  rational  explanations. 
All  of  these  macro-  and  micro-variables  could,  and  perhaps 
should,  be  measured  in  a  study  of  quality  of  day  care. 

On  the  other  hand,  the  NDCS  operated  in  actual  day 
care  settings  with  substantial  variety  in  their  environments, 
and  one  of  the  study  objectives  was  to  describe  links  that 
generally  had  not  been  studied  previously.     Therefore  it 
seemed  wisest  to  try  to  obtain  a  broad-brush  picture  of 
caregiver  behavior  in  actual  day  care  settings,  focusing 
on  broad  patterns  of  interactions  assumed^  to  be  especially 
sensitive  to  classroom  composition  variables,  and  on  broad 
qualities,  such  as  amount  of  direct  interaction  with  chil- 
dren versus  more  passive  supervision.     To  that  end,  the 
observations  were  focused  on  describing  the  daily  process 
in  the  day  care  classrooms,  including  what  caregivers  did 
with  children  (e.g.,  teach  vs.  observe),  their  verbal 
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techniques  (e.g.,  command  vs.  question),  and  whom  they 
worked  with  (one  child  vs.  larger  groups). 

Direct  observation  of  caregivers  in  day  care 
center  classrooms  was  the  major  method  used  to  measure 
caregiver  behavior.     Use  of  observations  to  study  behavior 
in  natural  settings  such  as  day  care  is  a  procedure  that  has 
strong  intuitive  appeal.    The  connection  between  data  and 
phenomena  is  unusually  direct.     Natural  observations  avoid 
the  artificiality  that  opens  many  laboratory  studies  to  the 
charge  that  their  findings  have  nothing  to  do  with  real-world 
behavior.     Use  of  such  observations  in  the  ndcs  exemplifies 
the  -ecological-  approach  to  the  study  of  child  development 
urged  by  some  of  the  field's  most  prominent  spokesmen, 
notably  urie  Bronf enbrenner . 

Study  Design 

The  NDCS  was  conducted  in  57  day  care  centers  in 
three  sites.*    Atlanta,  Detroit  and  Seattle  were  chosen  as 
the  study  sites;  and  a  total  of  57  centers  subsequently  were 
selected  for  participation.    The  centers  were  selected  for 
high  or  low  values  of  staff/child  ratio,  group  size  and 
staff  education. 

The  study  covered  three  years,     site  and  center 
selection  were  carried  out  during  Phase  I  of  the  study,  July 
1974  to  September  1975.     The  year  following  site  selection 
was  devoted  to  a  study  of  naturally  existing  relationships 
between  regulatable  center  characteristics  and  measures  of 
classroom  process,  including  caregiver  observations.  This 
phase  of  the  study  was  used  to  (1)  formulate  initial  hypoth- 
eses about  relationships  among  regulatable  center  character- 
istics, classroom  process  and  developmental  outcomes;  and 


*See  NDCS  Phase  I  Final  Report  (1976). 
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(2)  refine  the  measures  of  regulatable  characteristics, 
classroom  process  and  developmental  outcomes  to  be  used  in 
in  the  third  and  final  year  of  the  study.* 

Phase  III  (October  1976  to  September  1977)  was 
designed  to  answer  the  study's  three  major  policy  questions. 
The  Phase  III  investigation  had  two  components:     a  quasi- 
experiment  conducted  in  49  of  the  centers  in  all  three 
sites,  and  a  randomized  experiment  conducted  in  eight 
centers  operated  by  the  Atlanta  Public  Schools  (APS). 
These  eight  APS  centers  were  not  included  in  the  49-center 
sample,     in  both  studies,  selected  center  characteristics 
were  altered  systematically,  permitting  measurement  of  the 
effects  on  caregiver  behavior  associated  with  such  changes. 
Also,  there  was  sufficient  natural  variation  in  all  of  the 
policy  measures  to  allow  examination  of  the  associations 
between  the  unaltered  measures  and  caregiver  behavior. 

49-Center  Quasi-Experimental  Study 

The  quasi-experiment  in  49  of  the  centers  was  a 
comparison  of  three  groups  of  centers  (Table  1.1).     Group  I 
(the  "treatment"  group)  consisted  of  14  centers  which  had 
low  observed  staff/child  ratios  (1:9.1)   in  Phase  II,  and 
whose  ratios  were  increased  to  1:5.9  in  Phase  III.**  Effects 
of  this  treatment  on  caregivers  and  children  were  compared 
with  results  from  a  matched  group  of  14  untreated  centers 
with  naturally  low-ratio  (1:9.1),  labeled  Group  II,  and  a 
group  of  21  untreated  centers  with  naturally  hiqh  ratio 


*  See  NDCS  Second  Annual  Report,  1975-1976. 

**Note  that,   in  conformance  with  HEW  directives,  manipulations 
consisted  only  of  making  low  ratios  higher.     The  Group  I 
treatment  simulates  one  potential  effect  of  full  enforcement 
of  FIDCR  under  Title  XX — namely  an  increase  in  ratios  in 
centers  serving  publicly  funded  children  but  currently 
operating  below  FIDCR  ratios. 


Table  1.1 

DESIGN  OF  THE  49-CENTER  QUASI-EXPERIMNENT 


Group  I 


Treated  centers 

(Observed  mean  ratio  for  14  centers 
1:9.1  in  Phase  II;  ratio  raised  to 
1:5.9  in  Phase  III) 


Group  II    -         Untreated  low-ratio  centers 

(Observed  mean  ratio  for  14  centers 
1:9.1) 


Group  III  -         Untreated  high-ratio  centers 

(Observed  mean  ratio  for  21  centers 
=  1:5.9) 
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(1:5»9),  labeled  Group  III.     The  question  of  central  inter- 
est in  the  quasi-exper iment  was  whether  the  experimentally 
induced  increase  in  staff/child  ratio  would  produce  differ- 
ent caregiver  behaviors  than  were  seen  in  the  matched  low- 
ratio  centers  (Group  I  vs.  Group  II).    A  supplementary 
question  was  whether  the  treated  and  untreated  high-ratio 
centers  (Group  I  and  II)  looked  different.     That  is,  would 
the  experimental  increase  in  ratio  eliminate  most  or  all 
differences  between  centers  that  previously  operated  at 
different  ratios,  or  would  differences  in  outcomes  con- 
tinue to  exist,  presumably  because  of  other  center  charac- 
teristics that  normally  accompanied  high  ratios  but  were 
unaffected  by  the  experimental  increase  in  ratio? 

Ratio  was  chosen  for  manipulation  because  of  its 
critical  policy  relevance.    Group  size,  caregiver  experience 
and  years  of  education  were  distributed  as  evenly  as  possible 
across  the  three  experimental  groups,  so  that  the  effect  of 
ratio  could  be  clearly  separated  out.    No  attempt  was  made 
in  the  quasi-experiments  to  alter  natural  variations  in  age- 
grouping.  The  three  sets  of  ratios  applied  to  classrooms 
that  served  primarily  three-  and  four-year-old  children. 
In  some  centers,  three-year-olds  were  clearly  separate  from 
f our-year-olds;   in  others,  the  two  ages  were  mixed  in  the 
same  classroom* 

APS  Study 

The  APS  Study  was  an  eight-center,  29-classroom 
experiment  in  which  children  wers  randomly  assigned,  within 
centers,  to  classrooms  that  differed  systematically  in 
level  of  staff  education  and  staff/child  ratio  (Table  1.2). 
Group  size  and  caregiver  experience  were  distributed  as 
evenly  as  possible  across  the  three  experimental  groups. 
Twelve  of  the  experimental  classrooms  served  three-year  old 


Table  1.2 


DESIGN  OF  THE  ATLANTA  PUBLIC  SCHOOLS  (APS^ 
EIGHT-CENTER  EXPERIMnT  " 


High  Ratio  low  Ratio 

(Observed  (Observed 

Mean  Ratio  =  Mean  Ratio  = 

^--5,4)  1;7,4) 


High  Staff 

Education*         4  classrooms  4  classrooms 

Medium  Staff 

Education*         7  classrooms  4  classrooms 

Low  Staff 

Education*         6  classrooms  4  classrooms 


Level  of  education  was  defined  by  the  education  of 
the  lead  teacher  in  the  classroom.     High  =  Master' 
Degree;  medium  =  a  degree  from  Atlanta  Area  Tech 
(2-year  program);  low  =  high  school  degree. 
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children  and  17  served  four-year  olds.     This  design  made 
possible  a  relatively  clearcut  assessment  of  the  effects  and 
interactions  of  staff  education  and  staff/child  ratio  for 
children  of  different  ages  (three-  and  four-year  olds). 

Staff  in  the  APS  centers  fell  into  three  distinct 
categories  of  educational  background.     First,  center  direc- 
tors (who  were  required  to  work  in  classrooms  as  well  as  to 
function  as  directors)  had  bachelor's  degrees;  most  also  had 
master's  degrees.     Second,  lead  teachers  were  graduates  of 
the  Atlanta  Area  Technical  School  (AAT)   two-year  post-secon- 
dary training  program  in  day  care  or  had  completed  at  least 
two  years  of  college.     Third,  aides  generally  had  high 
school  diplomas   (or  an  equivalent  such  as  the  G.E.D.);  the 
majority  of  aides  had  also  completed  the  60-hour  state- 
required  training  courses  in  day  care  offered  through  aaT. 
As  shown  in  Table  1.2,  persons  at  these  three  levels  of 
education  were  assigned  to  be  lead  teachers  in  the  experi- 
mental APS  classrooms — some  in  classes  with  relatively  high 
staff/child  ratios,  others  in  classes  with  lower  ratios. 
Thus,  ratio  and  educati-oif^ere  crossed  in  a  two-way  factor- 
ial design.     Children  were  then  randomly  assigned  within 
centers  to  these  experimentally  organized  classes.  Random 
assignment,  together  with  the  fact  that  the  children  served 
by  APS  centers  were  unusually  homogeneous  in  ethnic  and  so- 
cioeconomic background  (virtually  all  were  black  children 
from  low-income  families)  minimized  any  confounding  of  cen- 
ter characteristics  and  children's  background  characteristics. 

Summary 

The  two  Phase  III  components  addressed  the  same 
questions  but  had  designs  with  different  experimental 
strengths  and  weaknesses.     Because  the  49-center  study 
included  a  large  and  diverse  group  of  centers  in  three- 
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different  sites,  its  results,  if  uniform  across  the  sample, 
were  likely  to  be  widely  general izable;  however,  the  diver- 
sity of  the  sample  also  posed  challenges  for  analysis  and 
interpretation.     The  APS  study  provided  a  greater  degree  of 
experimental  control  and  afforded  more  safeguards  against 
confounding  of  center  characteristics  with  characteristics 
of  the  children,  families  or  communities  served.  However, 
the  generalizabiUty  of  its  results  was  potentially  limited 
by  the  homogeneity  of  the  sample.     The  consistent  results 
actually  obtained from  the  two  study  components  constitute 
-a-f-^r-sounder-basis  for  policy  conclusions  than  would 
findings  from  either  component  alone. 
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CHAPTER  TWO;     OBSERVATIONS  OF  CAREGIVERS 


Once  the  decision  was  made  to  measure  caregiver 


behavior  through  direct  observation,  it  was  necessary  to 
designate  which  caregivers  were  to  be  observed  and  when,  in 
order  to  obtain  a  reliable  and  representative  picture  of 
behavior,  and  to  select  an  instrument  appropriate  to  the 
NDCS  purposes.     This  Chapter  describes  the  data  collection 
procedures  and  the  observation  system  that  was  used  to  re- 
cord caregiver  behavior.     This  discussion  is  followed  by  a 
broad  outline  of  the  analyses  of  the  caregiver  observations. 

Phase  III  Samples  and  Procedures 

Observations  were  conducted  in  all  57  NDCS  study 
centers  at  two  times  during  Phase  III  of  the  study:  October 
1976  and  April  1977.    Caregivers  were  observed  in  all  class- 
rooms that  enrolled  a  majority  of  three-  and  four-year-old 
children.     Two  hundred  and  ten  caregivers  were  observed  in 
the  fall;  220  were  observed  in  the  spring. 

The  staff  observed  included  both  lead  teachers  and 
aides.     The  sample  represents  a  total  census  of  lead  teachers 
in  these  classrooms,  since  typically  there  was  only  one  lead 
teacher  in  a  given  classroom.     It  represents  only  a  partial 
sampling  of  aides,  however,  for  two  reasons.     First,  in 
classrooms  with  multiple  caregivers,  only  one  aide  was 
observed  per  classroom,  regardless  of  the  total  number  of 
aides  assigned  to  the  classroom.     In  the  NDCS  target  class- 
rooms, the  average  number  of  aides  (full-and  part  time)  was 
2.8,  so  the  total  number  of  aides  observed  was  a  relatively 
small  proportion  (between  one  quarter  and  one  third)  of  the 
total  number  of  aides  in  the  classrooms.     Furthermore,  in  a 
number  of  classrooms  that  had  multiple  caregivers,  only  the 
lead  teacher  was  observed.     Second,  in  both  the  fall  and  the 


14 


spring,  approximately  twice  as  many  lead  teachers  as 
aides  were  observed.     This  discrepancy  occurred  primarily 
because  aides  were  much  less  stable  in  attendance  in  the 
classrooms.     Most  worked  part-time,  and  absence  was  much 
more  frequent  among  aides,     it  consequently  was  more  diffi- 
cult to  complete  observations  on  aides.     For  these  reasons, 
results  of  analyses  of  the  aide  sample  are  treated  more 
tentatively  than  results  for  lead  teachers. 

in  classrooms  where  only  a  lead  teacher  was  ob- 
served, the  teacher  was  observed  for  two  mornings  in  a  week. 
Where  a  teacher  and  an  aide  in  a  classroom  were  observed, 
each  was  observed  the  equivalent  of  a  morning,  usually  on 
two  days  during  a  week.     Observations  of  caregivers  were 
restricted  to  the  hours  between  9  a.m.  and  noon,  since  this 
is  the  most  stable*  period  of  the  day  in  terms  of  child  and 
caregiver  attendance.  It  is  also  the  period  most  linked  with 
planned  educational  activities,  which  increased  the  oppor- 
tunities to  see  caregivers  interacting  with  the  children. 

In  the  fall,  all  observations  of  an  individual 
classroom  were  conducted  by  the  same  observer,     in  the 
spring,  however,  two  observers— one  white  and  one  black- 
were  assigned  to  each  classroom,  and  the  focus  caregiver 
was  observed  an  equal  amount  of  time  by  each  observer.  This 
change  in  procedure  permitted  examination  of  coding  differ- 
ences that  could  be  attributed  to  an  observer's  race  and 
distributed  any  coding  differences  across  caregivers  and 
classrooms. 


Twenty-one  observers  collected  data  on  caregivers. 
Observers  were  selected  from  the  local  community  at  each 
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site  and  trained  by  SRI  International  for  approximately  one 
week  just  before  each  data  collection  period.     (A  detailed 
description  of  the  training  may  be  found  in  SRI's  Phase  III 
Report.)     At  both  data  collection  points^  observers  were 
essentially  comparable  on  all  their  background  characteris- 
tics except  race.     Most  observers  were  female,  and  college 
graduates  or  soon  to  be  college  graduates;  the  average  age 
was  about  33  years,  with  observers  in  Detroit  tending  to 
be  slightly  older  than  the  others.    The  primary  difference 
between  the  observers  hired  in  the  fall  and  those  hired  in 
the  spring  was  their  race.     In  the  fall,  most  observers 
(70%)  were  white,  while  in  the  spring,  the  number  of  black 
and  white  observers  was  almost  equal  in  order  to  accommodate 
biracial  observation  teams. 


The  Adult-Focus  Instrument 


The  instrument  chosen  to  record  behavior  was  the 
SRI  Preschool  Observation  Instrument,  or  Adult-Focus 
Instrument  (AFI) •     The  AFI  had  previously  been  used  by  SRI 
International  in  evaluating  the  Follow  Through  and  Head 
Start  Planned  Variation  projects.     It  was  modified  (and 
hence  renamed)   for  the  NDCS  to  record  adult  behavior  in  day 
care  centers.     The  AFI  is  designed  to  describe  the  day  care 
classroom  environment  and  to  record  the  behavior  of  individu 
caregivers.     The  instrument  has  three  sections: 


•  Physical  Environment  Inventory — a  description 
of  the  equipment  present  in  a  classroom; 

•  Classroom  Snapshot — a  recording  of  the  numbers 
of  staff  and  children  present  at  a  specific 
point  in  time,  and  their  activiites  and  group- 
ings; and 

•  Five-Minute  Interaction  (FMI) — a  record  of  the 
behavior  of  a  single  focus  caregiver  during  a 
five-minute  period. 
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Descriptive  data  from  the  Physical  Environment 
Inventory  were  combined  statistically  into  a  single  rating 
of  physical  quality  for  each  center,  and  data  taken  from 
center  space  plans  were  used  to  confirm  that  NDCS  centers 
met  or  exceeded  state  licensing  requirements  for  indoor  and 
outdoor  square  footage  per  child.     Classroom  Snapshot  data 
were  used  mainly  to  provide  group  size  and  staff  counts 
for  computing  the  classroom  composition  measures,  while  the 
Five-Minute  Interactions   (FMI's)   provided  the  bulk  of  the 
data  used  in  the  major  analyses  of  caregiver  behavior.  It 
is  through  a  detailed  analysis  of  the  FMI  data  in  conjunc- 
tion with  the  policy  variables  that  the  relationships 
between  regulatable  center  characteristics  and  caregiver/ 
child  interaction  were  assessed. 

The  FMI's  were  designed  to  record  a  narrative 
description  of  caregiver  behavior.     Each  FMI  consists  of 
five  minutes  of  observation,  broken  into  63  interaction 
frames.  Observers  were  allowed  to  set  their  own  rate  of 
coding  on  the  FMI's;  a  maximum  of  63  frames  could  be  coded 
during  five  minutes  'of  observation,  but  no  minimum  was  set. 
Since  each  FMI  covered  only  five  minutes  of  observation, 
in  an  observation  period  multiple  FMI's  were  completed  on 
a  caregiver.* 

Each  frame  in  the  FMI  is,  in  effect,  a  sentence 
about  an  action  observed,     it  describes  the  actor  (WHO),  the 
object  of  the  action  (TO  WHOM) ,  the  content  of  the  action 
(WHAT),  and  the  style  (HOW).     (in  the  NDCS  observations, 
the  focus  caregiver  being  observed  was  either  the  WHO  or 
the  TO  WHOM  of  the  action  in  each  frame  of  the  FMI.)  m 


In  the  NDCS  study,  the  average  length  of  observation  of 
a  caregiver  in  a  single  caregiver  classroom  was  3  hours 
(approximately  36  FMI's);  in  a  two-caregiver  classroom. 
It  was  1  1/2  hours  (or  18  FMI's). 
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each  frame  of  an  FMI,  one  code  for  WHO,  TO  WHOM,  and  WHAT 
had  to  be  recorded.    As  shown  in  Table  2.1,  there  were  12 
WHAT  codes  to  choose  from  to  indicate  the  action  or  behavior 
that  was  occurring.    These  codes  are  the  most  important  in 
the  analyses,  so  brief  definitions  are  provided  in  Table 
2.2.     The  12  WHO/TO  WHOM  codes  listed  in  Table  2.1  are 
basically  self-explanatory.    The  HOW  codes  provide  informa- 
tion about  the  action  that  is  occurring,  describing  its 
content  or  affect.     HOW  codes  were  optional;  although  none 
or  from  one  to  six  codes  could  be  recorded  per  frame,  the 
average  number  recorded  per  frame  was  one.    The  relative 
frequencies  of  occurrence  of  the  AFI  codes  are  presented 
and  discussed  in  Chapter  Three. 

Introduction  to  the  AFI  Analyses 

The  AFI  analyses  fall  into  three  groups.  First, 
the  frequencies  and  variabilities  of  all  the  codes  from  the 
FMI  were  examined,  which  produced  a  description  of  caregiver 
behavior  in  these  day  care  centers.     This  description  helped 
set  a  context  for  the  subsequent  analyses  linking  caregiver 
behavior  and  the  key  program  characteristics.    Two  types  of 
linking  (or  effects)  analyses  were  carried  out.     First,  for 
the  49-center  quasi-exper iment ,  a  series  of  one-way  analyses 
of  variance  were  done  using  the  three  groups  of  centers 
(Table  1.1)  as  levels  of  an  independent,  classifactory  var- 
iable, and  the  FMI  codes  as  dependent  variables.  Second, 
there  was,  within  each  of  the  various  experimental  groups  of 
centers  and  classes,  a  great  deal  of  variation  not  only  in 
the  experimentally  manipulated  variables  (ratio  and  staff  - — 
education)  but  also  in  other  regulatable  characteristics — 
group  size,  staff  experience  and  content  of  caregivers' 
education  or  training.    These  naturally  occurring  varia- 
tions were  examined,  though  multiple  regression  analysis, 
in  relation  to  the  caregiver  variables.    These  regressions 
are  the  central  effects  analyses  for  caregiver  behavior. 


^0 

18 


Table  2,1 

III  AFI  CODES  USED  IN  THE  FIVE  MINUTE  INTERACTTONfi 


WHO/TO  WHOM 


HOW 


Teacher 

Aide 

Parent 

Volunteer/Visitor 
Child 

Different  child 

Toddler 

Infant 

Small  Group  (2-7) 
Medium  Group  (8-12 
Large  Group  (13+) 
Other 


Task 

Behavior 

Utilitarian 

Negative 

Happy 

Guide 

Punish 

Sad 

Dramatic  Play 

Materials 

Rule 


Touch 

Nonverbal 

Movement 


WHAT 


Commands 

Direct  Questions 
Open-Ended  Questions 
Responds 
Instructs 

Adult  Self-Related  Activity 

or  Conversation 
Center-Related  Statements 

and  Activity 
Supports/Comforts 
Praises/Acknowledges 
Corrects 
No  Response 
Rejects 

Observes/Attends 


Table  2.2 

DEFINITIONS  OF  "WHAT"  CODES  FROM  THE  AFI 

COMMAND:        An  order  that  asks  for  a  response  free  of  arguments 

QUESTION:      Request  for  direct  recall  of  material,  a  statement 
of  preference. 


RESPONSE:      Compliant  response  to  a  command,  question, 
correction,  or  to  praise. 


INSTRUCT:      Demonstrations  of  activities  explanation  of 
rules,  provision  of  information. 


ADULT- 
RELATED 
ACTIVITY: 


Verbal  and  nonverbal  activity  between  adults  that  is 
non-center  and  non-child  focused . 


CENTER-  Statements  or  activities  that  involve  children  or 

RELATED         tasks  in  the  center. 

ACTIVITY: 


COMFORT:        Statements  or  activities  of  affectionate  attention 
and  comfort. 


PRAISE:         Approval,  praise,  acknowledgement,  recognition, 
verbal  or  nonverbal. 


CORRECT:        Attempts  to  change  or  modify  a  response,  feeling, 
product  or  behavior. 


NO  A  compliant  response  is  expected  but  does  not 

RESPONSE:  occur. 

REJECT:  Negative,  noncompliant  responses,  verbal  or  nonver: 


OBSERVE:        Adult  listens  to  or  observes  others. 
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An  important  decision  made  prior  to  any  of  the 
analyses  was  the  choice  of  an  appropriate  level  of  analysis 
— caregiver-level  or  classroom-level,     since  a  teacher  and 
an  aide  were  observed  in  many  classrooms,  the  observation 
data  could  be  combined  to  form  classroom-level  measures; 
alternatively,  the  groups  of  teachers  and  aides  could  be 
examined  separately.     The  latter  approach  was  taken.  The 
decision  to  do  analyses  at  the  caregiver-level  was  made 
primarily  because,  as  previously  described,  the  aide  sample 
was  incomplete.     Because  some  classrooms  with  aides  had  no 
aide  data  and  many  classrooms  with  multiple  aides  had  data 
from  only  one  aide,  it  did  not  seem  valid  to  combine  the 
data  of  teacher (s)  and  aide(s)   from  the  same  classroom. 


CHAPTER  THREE:     THE  CAREGIVER  IN  THE  CLASSROOM; 


DESCRIPTION  OF  CAREGIVER  BEHAVIOR 


The  observation  data  provide  a  picture  of  the 
daily  process  in  NDCS  centers.     This  picture  helps  set  the 
stage  for  the  effects  analyses  by  indicating  which  kinds  of 
behavior  were  frequent  and  which  were  rare,  and  how  the  type 
of  activity  and  the  configuration  of  actors  (numbers  of 
adults  and  children)  were  related.     The  FMI  data  shown  in 
Table  3.1  provide  a  picture  of  the  content  or  quality  of  the 
interactions  between  caregivers  and  children  through  the 
WHAT  and  HOW  codes.     The  TO  WHOM  codes  describe  the  pattern 
of  activity  subgroups,   (i.e.,  the  number  of  children  actually 
interacting  with  a  particular  caregiver,  as  opposed  to  the 
total  number  of  children  under  supervision  of  the  caregiver 
or  team  of  caregivers). 

Content  of  Caregiver  Interactions 

In  terms  of  qualitative  differences  in  caregiver/ 
child  interactions,  the  FMI  WHAT  codes  can  be  organized  into 
four  broad  dimensions:     1)   social  interaction,  involving 
positive  caregiver/child  interactions,  both  directive  and 
nondirective;   2)   management,  involving  caregiver/child 
interactions  focused  on  amending  children's  behavior;  3) 
observation/supervision,  when  the  caregiver  stands  back  and 
watches  children;  and,  4)  center-  or  adult-related  behavior, 
involving  caregiver  actions  in  which  children  are  not  focal. 
The  first  two  dimensions  represent  active  engagement  with 
children;  together  they  comprised  an  average  of  45  percent 
of  a  caregiver's  time.     The  latter  two  dimensions  represent 
non-interactive  behavior  and  occupy,  on  the  average,  ovfer 
half  of  a  caregiver's  time  (Table  3.1).     In  particular,  an 
average  of  nearly  20  percent  of  a  caregiver's  time  was  spent 
observing/attending  children,  and  the  remaining  35  percent 
was  spent  in  either  center-  or  adult-related  activity. 


22 

^.9 


Table  3.1 


CAREGIVERS'  ACTIONS  TOWARD  DIFFERENT  RECIPIENTS; 
MEAN  PROPORTIONS  (STANDARD  DEVIATIONS)  OF  WHAT  AND  TO  WHOM  CODES.  SPRING  AFI 

(l*=220) 


TO  WHOM  Code 


(2-7)  (8-12)  (13+) 

WHATCfldP  ^^"^  ^"^^^  Staff  and 

mm       lihild        Groue  GroiiE,  GrouE  Children  Environment 

X  (s.d.)     X  (s.d.)  7  (s.d.)  X  (s.d.)  X  (s.d.)  x 


Comnands 

.057  (.028) 

.009  (.008) 

.008  (.014) 

.009  (.014) 

.083  (.038) 

Corrects 

.052  (.028) 

.006  (.005) 

.003  (.008) 

.003  (.006) 

.064  (.035) 

Instructs 

.022  (.024) 

.016  (.027) 

.022  (.007) 

.021  (.039) 

.081  (.060) 

Questions 

.044  (.028) 

.005  (.008) 

.005  (.011) 

.004  (.009) 

.058  (.034) 

.003 

Response 

.016  (.013) 

.000 

.000 

.000 

.016  (.013) 

.003 

Comforts 

.012  (.014) 

.000 

.000 

.000 

.012  (.014) 

Praises 

.038  (.026) 

.002  (.003) 

.002  (.005) 

.002  (.005) 

.043  (.029) 

Center-related  .058  (.042) 

.010  (.014) 

.007  (.013) 

.008  (.020) 

.084  (.054) 

.289 

Adult-related 

.000 

.000 

.000 

.000 

.000 

.050 

'Observes 

.024  (.027) 

.048  (.055) 

.046  (.062) 

.085  (.112) 

.203  (.114) 

.007 

TOTAL 

.323  (.125) 

.096  (.077) 

.093  (.110) 

.132  (.141) 

.644  (.145) 

.352 

The  social  interaction  and  management  dimensions 
included  the  codes  COMMANDS,  CORRECTS,  INSTRUCTS,  RESPONDS, 
PRAISES,  COMFORTS,  and  QUESTIONS.     All  of  these  codes  were 
positively  correlated  with  each  other,  and  negatively  corre- 
lated with  the  codes  representing  passive  caregiver  behavior 
with  children—OBSERVE  AND  ADULT  ACTIVITY  (Table  3.2).  Of 
particular  interest  among  the  interactive  behaviors  was  the 
amount  of  instructing  which  occupied  eight  percent  of  the 
caregiver's  time.  An  additional  15  percent  of  the  caregiver 
observations  were  coded  as  COMMANDS  or  CORRECTS,  which  rep- 
resent efforts  to  alter  behavior,  manage  or  control  children. 
These  two  codes  were  strongly  correlated  (Table  3.2).  The 
remaining  13  percent  of  caregiver  time  was  spent  "warmly" 
interacting  with  children — praising,  comforting,  asking 
questions  of  and  responding  to  children,  a  set  of  codes  that 
also  were  highly  intercorrelated.     (Note  that  the  codes 
COMFORTS  and  RESPONDS  were  particularly  infrequent.) 

The  20  percent  of  a  caregiver's  time  spent  observ- 
ing/attending children  was  approximately  twice  as  much  as 
any  other  single  caregiver  activity  with  children.  Observ- 
ing is  not  inherently  passive,  but  the  pattern  of  correla- 
tions among  the  WHAT  codes  suggest  that,  within  the  range  of 
frequencies  observed  in  the  NDCS,  more  observing  meant  less 
of  almost  all  other  activities  with  children.     OBSERVES  was 
negatively  correlated  with  all  of  the  other  codes  except 
ADULT  ACTIVITY.     Although  intelligent  observation  of  chil- 
dren is  a  hard-won  skill  of  the  trained  caregiver,  the  in- 
strument could  not  distinguish  different  types  of  observing 
by  caregivers. 

An  average  of  a  third  of  a  caregiver's  time  was 
spent  in  activities  that  did  not  involve  verbal  interaction 
with  children.     Most  of  this  time  was  in  CENTER-RELATED 
ACTIVITY,  such  as  preparing  or  passing  out  materials.  Only 
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Table  3.2 
INTBKXIRRELATIONS  OF  WHAT  AMD  TO  M 


(N*220) 


2  3  4  5  6  7  6 


OOrtlAND 

a^RRGCT 
QUESTION 

.41**  .30** 
.20** 

.16** 
.22** 

.20** 

.14* 

.29** 

-.29** 
-.23** 
-.27** 

-.37** 
-.30** 
-.37** 

.09 

.2* 
.!£ 
.5C 

RESPOND 
INSTRUer 
ADULT  ACTlVITy 

.17** 

-.17* 
-.16* 

-.09 
-.33** 

-.08 

 ™ 

•  4j 

.27 

-.32 

CENTER  ACTIVITY 
COMFORT 

praise: 

-.31 
.14 

OBSERVE 

JU  1  iJHlLU   ■  =  

TO  SMALL  GHOUP 
TO  MEDIUM  GROUP 
TO  LARGE  GROUP 

TO  STAFF  ~  

Note:    Correlations  reported  are  p<.\5.    Correlations  with  one  asterisk  are  siqnifica 
at  p<.01.  ^ 


five  percent  of  a  caregiver's  time,  on  the  average,  was 
spent  in  activities  that  were  neither  child-related  nor 
center-related. 

The  pattern  of  caregiver  behavior  that  emerged 
was  strikingly  similar  in  quality  and  quantity  for  both  the 
fall  and  spring  observations.     It  is  apparent  that  care- 
givers must  display  some  amount  of  management  behavior, 
social  interaction,  passive  observation  and  non-child  re- 
lated activities  to  run  a  day  care  classroom  effectively. 

Teachers  and  aides  behaved  somewhat  differently  in 
the  classroom.     Compared  to  teachers,  aides  did  less  command- 
ing and  instructing,  and  more  observing  (Table  3.3).  This 
pattern  is  predictable,  since  aides  in  the  NDCS  classrooms 
typically  acted  as  assistants  with  less  responsibility  than 
the  lead  teacher. 

Object  of  Caregivers'  Interactions 

The  broad  picture  of  caregiver  behavior  gained 
from  the  WHAT  codes  can  be  expanded  by  studying  the  recip- 
ients of  the  caregivers'  attention.    Approximately  one-third 
of  caregivers*   time  was  spent  with  individual  children, 
one-third  with  groups  of  children,  and  the  remaining  third 
either  with  other  staff  or  in  solitary  preparation  of 
materials  (Table  3.1).     Of  the  time  with  children,  about 
half  was  spent  with  individual  children,  while  the  remaining 
half  was  almost  equally  divided  among  small,  medium  and 
large  groups  of  children.     Teachers  and  aides  looked  very 
similar  in  how  their  attention  was  distributed  (Table  3.3). 

_____  — Wha^t—eareql'vers^l d~ and  whom  they  worked  with 

were  strongly  related.     The  joint  distribution  of  WHAT  and 
TO  WHOM  codes  suggests  that  different  kinds  of  activities 
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O^ble  3.3 


MEAN  FREQUENCIES  OF  WAT  AND  TO  VBOM  CmEfi 
Ag^  jWCTlON  OF  CAREGIVER  JOB.  SPRING  AFT 
(N»173*)  ■ 


Teachers 
(n=ll5) 


Aides 
(n=58) 


WHAT  Cbdes 


COMMANDS 

.086 

.070 

QUESTIONS 

.061 

•059 

RESPONDS 

•  022 

.019 

INSTRUCTS 

•  090 

•068 

ADULT-REUTED  ACTIVITY 

.060 

.033 

CEOTER-RELAOH)  ACTUITY 

.380 

•380 

COMFWTS 

•015 

•013 

PRAISES 

•047 

.047 

CORRECTS 

•066 

•064 

OBSERVES 

.172 

•  240 

.01 


.01 


.00 


TO  WHOM  Codes 

TO  1  CHILD 
TO  SMALL  GROUP 
TO  MEDIUM  GROUP 
TO  LARGE  GROUP 
TO  CHILDREN 
TO  STAFF 
 TO  FNVIRCNMENT  - 


*341 
•082 
.091 

•  109 
•634 

•  057 
T278~ 


•341 

•  117 
.077 

•  118 
•653 
.064 


.05 


.266 


^^"^  ^!  ^^^^  P^^^^  school  centers  were  not 
S^l  oTi^T^      manipulations  of  job  functions  made  as 

**p  values  recorded  only  if  p<.15. 
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occurred  with  different  numbers  of  children  (Table  3.1). 
(This  is  also  borne  out  in  the  correlations  of  the  WHAT  and 
TO  WHOM  codes  shown  in  Table  3.2).     When  caregivers  were 
instructing,  they  were  as  likely  to  be  involved  with  more 
than  one  child  as  with  individual  children.    Other  activi- 
ties—QUESTIONS,  RESPONDS,  COMPORTS,  AND  PRAISES — occurred 
nearly  exclusively  with  individual  children.    These  were 
"warmer*  and  most  interactive  codes.     COMMANDS,  CORRECTS, 
and  CENTER-RELATED  ACTIVITY  occurred  mostly  with  individual 
children  but  also  with  groups. 

The  code  OBSERVES  was  in  a  class  by  itself;  it 
became  more  frequent  as  the  sizes  of  groups  increased  and 
was  usually  recorded  between  a  caregiver  and  a  large  group 
of  children.     Caregivers  observed/  supervised  larger  groups 
of  children  during  free  play  periods;  observation  of  smaller 
groups  occurred  in  both  free  play  and  during  task-oriented 
activities  where  the  caregiver  had  structured  the  activity 
and  then  let  the  children  work  on  their  own. 

Two  codes — ADULT-RELATED  ACTIVITY  and  CENTER- 
RELATED  ACTIVITY — were  used  primarily  to  record  caregivers' 
interactions  with  staff  or  the  environment.     By  defini- 
tion, ADULT-RELATED  ACTIVITY  never  occurred  with  children. 
CENTER-RELATED  ACTIVITY  was  observed  with  children  an 
average  of  only  eight  percent  of  the  time  but  with  adults 
or  with  materials  29  percent  of  the  time. 

How  Caregivers  Interacted 

The  remaining  set  of  PMI  codes — the  HOW  codes — 
described  the  manner  in  which  caregivers  interacted  with 
children.     Because  they  were  optional,  all  of  the  HOW  codes 
were  recorded  infrequently,  and  therefore  the  codes  were 
not  analytically  useful.     Only  about  half  of  the  codes  had 
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frequencies  above  .01  (Table  3.4).     Further,  the  HOW  codes 
with  the  highest  fraquencies,  such  as  MOVEMENT,  were  of 
least  substantive  interest,  while  those  most  closely  tied 
to  theoretical  concepts  such  as  "warmth"  were  rare  events. 

Caregiver  affect  was. of  some  interest.  Overt 
affect— NEGATIVE  or  POSITIVE— was  coded  relatively  rarely; 
however,  POSITIVE  affect  was  lecorded  more  than  three  times 
as  often  a  3  NEGATIVE.     When  the  categories  of  POSITIVE 
affect  and  TOUCH  are  combined,  it  is  clear  that  some  posi- 
tive interaction  occurred  in  approximately  eight  pe-    it  of 
a  caregiver's  observations.    The  indicators  of  positive  and 
negative  effect  usually  accompanied  direct  caregiver-child 
interchanges.     POSITIVE  affect  was  coded  most  often  in  the 
context  of  praising.     Caregivers  touched  children  most  often 
while  comforting  them.     Not  surprisingly,  NEGATIVE  affect 
was  exhibited  most  often  when  caregivers  corrected  children, 
in  fact,  about  25  percent  of  the  time  that  CORRECT  was 
coded,  it  involved  NEGATIVE  affect  by  the  caregiver;  more- 
over, the  majority  of  the  caregivers'  corrections  were 
responses  to  children's  behavior  (or  misbehavior). 
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Table  3.4 

MEAN  PROPgyriONS  OF  HOW  CODES,  SPRING  API 
(N=220) 


X  s.d. 


Touch 

.036 

.03 

Nonverbal 

.275 

.12 

Movenient 

.181 

.09 

Task 

.100 

.08 

Response  to 
Child  Behavior 

.051 

.03 

Utility 

.131 

.09 

Negative,  Punish 

.008 

.01 

Positive,  Happy 

040 

.07 

Guide 

.008 

•  01 

Sad 

.000 

Dramatic  Play 

.003 

.01 

Materials 

.028 

.04 

Rule 

.004 

.01 

No  Response  to 
Child  Behavior 

.000 
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CHAPTER  FOUR;     AMALXSIS  OF  CAREGIVER  OBSERVATION  DATA; 

DEPENDENT  AND  INDEPENDENT  MEASURES 


Selection  and  Construction  of  Dependent  Measures 

For  the  effects  analyses,  all  of  the  WHAT  codes 
were  selected  as  dependent  measures,  along  with  those  TO 
WHOM  codes  which  occurred  with  frequency  above  .01.  The 
how  codes  were  rejected  because  of  their  low  frequencies  of 
occurrence  and  badly  skewed  distributions.     In  addition  to 
the  individual  WHAT  codes,  two  macro-codes—SOCIAL  INTER- 
ACTION AND  MANAGE— were  constructed  from  the  WHAT  codes  and 
used  as  summary  dependent  measures.     The  construction  of 
these  macro-coaes  is  described  below. 

Several  strategies  were  employed  in  an  attempt  to 
find  patterns  of  caregiver  behavior  among  the  individual  FMI 
codes  that  couin  be  represented  in  constructs  or  macro-codes. 
The  first  technique  used  was  a  principal  components  factor 
analysis  of  the  data,  which  revealed  little  underlying  struc- 
ture (i.e.,  no  stable  factor^).     The  first  factor  derived  in 
the  factor  analysis  accounted  for  less  than  15  percent  of 
the  variance;  no  other  factor  accounted  for  more  than  ten 
percent.  The  first  factor  presented  almost  exactly  the  same 
picture  as  the  simple  correlations;     ADULT-RELATED  ACTIVITY, 
CENTER-RELATED  ACTIVITY,  and  OBSERVES  had  negative  weights 
while  the  remaining  codes  had  high  positive  weights  (with 
the  exception  of  COMFORTS,  which  had  a  loading  of  essen- 
tially zero).     However,  since  this  principal  component  ac- 
counted for  relatively  little  variance,  no  single  summary 
construct  was  formed  from  the  FMI  codes. 

The  lack  of  guidance  from  the  factor  analysis  led 
back  to  the  raw  f  -quencies  of  the  codes  and  their  correla- 
tions, which  were  interpreted  with  the  help  of  an  empirical 
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understanding  of  behavior  in  day  care  settings.  Based  on  the 
correlations  (discussed  later  in  the  descriptive  analyses) 
and  the  conceptual  relations  among  codes,  two  constructs 
were  formed.     One,  labeled  MANAGE,  was  a  combination  of  the 
two  highly  correlated  codes  COMMANDS  and  CORRECTS.  This 
construct  represented  caregiver  efforts  to  change  or  control 
children's  behavior.     The  second  construct,  SOCIAL  INTERAC- 
TION, was  formed  by  combining  QUESTIONS,  RESPONDS,  INSTRUCTS 
PRAISES  and  COMFORTS.     The  SOCIAL  INTERACTION  construct  rep- 
resents all  verbal  social  interactions  between  caregivers 
and  children,  excluding  managing  children. 

The  intercorrelations  of  these  derived  constructs 
with  the  unaggregated  codes,  for  teachers  and  aides  combined 
appear  in  Table  4.1.     (The  pattern  of  correlations  among  the 
constructs  and  the  individual  codes  were  very  similar  when 
teachers  and  aides  were  analyzed  separately.)     As  expected, 
SOCIAL  INTERACTION  was  significantly  correlated  with  all  the 
component  codes  and  negatively  related  to  OBSERVE,  CENTER 
ACTIVITY  and  ADULT  ACTIVITY.     MANAGE  also  was  highly  corre- 
lated with  its  component  codes  and  negatively  correlated 
with  CENTER  and  ADULT  ACTIVITY.     On  the  other  hand,  MANAGE 
was  not  correlated  with  OBSERVE  or  with  some  of  the  social 
interaction  codes. 

Reliability  of  the  Dependent  Measures 

Effects  analyses  of  the  API  were  primarily 
aimed  at  determining  to  what  extent  variations  in  caregiver 
behavior  are  related  to  variations  in  group  size,  staff/ 
child  ratio,  and  caregiver  qualifications.     The  reliability 
of  the  API  dependent  measures  was  important  information  for 
developing  analytic  strategies  and  interpreting  the  results 
of  the  analyses.     Specifically,  the  reliability  results  were 
used  in  four  ways:     (1)   they  indicated  the  degree  to  which 
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Table  4.1 

CORRELATION  COEFFICIENTS  OF  WHAT  CODES  AND  CONSTRUCTS, 

SPRING  AFT^   

(n=220) 


SOCIAL 

INTERACTION  MANAGE 


Observes 

-.33** 

-.09 

Commands 

.29** 

.85** 

Corrects 

.21** 

.83** 

Questions 

.68** 

.34** 

Responds 

.54** 

.18** 

Comforts 

.19** 

Praises 

.76** 

.31** 

Instructs 

.77** 

.12 

Center-related 

Activity 

-.55** 

-.47** 

Adult-related 

Activity 

-.37** 

-.39 

MANAGE 

.30** 

♦Correlations  reported  are  significant  at  p<.15.  One 
asterisk  indicates  p<.05  and  two  asterisks  indicate 
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observer  effects  contaminated  the  observations;   (2)  they 
indicated  which  individual  codes  were  most  reliable;  (3) 
they  indicated  the  ceilings  on  the  proportions  of  variance 
in  the  AFI  measures  that  the  independent  measures  could  be 
expected  to  explain;  and   (4)   they  helped  in  deciding  which 
level  of  aggregation  would  be  most  appropriate  for  analysis. 

The  reliability  of  the  AFI  measures  was  assessed 
in  three  ways:     through  generalizability  computations, 
through  observer  agreement  (with  criterion  tapes  and  in 
tests  of  interobserver  agreement) ,  and  through  examination 
of  the  stability  of  the  measures  across  timepoints.*  In 
general,  the  reliability  analyses  indicated  that  the  mea- 
sures were  sufficiently  reliable  to  support  the  effects 
analyses,  i.e.,  a  significant  part  of  the  variance  in  the 
measures  could  be  expected  to  be  systematic  and  poten- 
tially explanable  by  the  policy  measures.     On  the  other 
hand,  the  measures  were  not  so  reliable  as  to  predict  that 
more  than  moderate  amounts  of  variance  would  be  accounted 
for.     The  analyses  also  indicated  that  the  broader  dependent 
measures,  especially  the  macro  codes  were  more  reliable. 

Observer  effects  were  examined  by  SRI  International 
through  observer  agreement  with  criterion  videotapes  and  a 
field-tested  interobserver  (paired)  agreement.    On  the  cri- 
terion videotapes,  agreement  on  all  AFI  codes  was  above  70 
percent,     in  the  field  test  of  interobserver  agreement,  ob- 
server pairs  of  one  black  and  one  white  member  observed  care- 
givers in  the  FMI's,  spaced  a  week  apart.     Rates  of  agree- 
ment were  approximately  90  percent  for  WHO  and  TO  WHOM  codes. 
Agreement  varied  from  62  to  89  percent  for  the  frequent  WHAT 


*Most  of  the  reliability  tests  were  done  on  spring  AFI  data 
because  in  the  spring,  each  caregiver  was  observed  by  two 
observers,  on  black  and  one  white,  which  enabled  clearer 
assessment  of  observer  effects. 
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codes, that  were  used  in  effects  analyses,  with  most  of 
these  codes  in  the  70-85  percent  range.     (The  infrequent 
nonoptional  WHAT  codes  generally  evidenced  somewhat  lower 
levels  of  agreement.)     HOW  codes  in  many  cases  produced  high 
percentage  agreement,  based  on  very  few  occurrences.  Black 
and  white  observers  differed  in  their  use  of  certain  codes; 
however,  many  of  these  differences  were  attributable  to  one 
or  two  observer  pairs  or  to  low  overall  frequencies  of  the 
codes  in  question.     On  the  whole,  SRI's  data  suggest  that 
interobserver  agreement,  while  far  from  perfect,  is  good 
enough  to  guarantee  that  recorded  frequencies  of  afI  codes 
are  determined  mainly  by  factors  outside  the  eye  of  the 
beholder . 

Day-to-day  stabilities  of  code  frequencies  were 
examined  for  203  caregivers  who  were  observed  on  two  consec- 
utive days  in  spring  1977.     Stability  coefficients,  shown 
in  the  first  column  of  Table  4.2,  are  correlations  between 
frequencies  of  the  same  code  measured  on  successive  days  for 
the  same  caregivers.     Modest  correlations  were  obtained— 
generally  around  .2.     These  indicate  some  tendency  for  pro- 
files of  caregiver  behavior  to  remain  the  same,  but  they 
also  show  that  behavior  fluctuates  in  response  to  the 
situation,  with  many  caregivers  showing  a  lot  of  a  given 
kind  of  behavior  on  one  day,  followed  by  relatively  little 
on  the  next  day.     (Low  values  of  coefficients  in  Table  3.6 
are  to  a  degree  artificial  in  that  using  two  observers  for 
each  caregiver  in  the  spring  data  collection  meant  changing 
observers  from  one  day  to  the  next,  which  contributed  to 
to  the  apparent  instability  of  codes.)     However,  in  light 
of  the  relatively  high  rates  of  interobserver  agreement 
obtained  in  SRI's  field  test,  the  relatively  weak  correla- 
tions shown  in  the  table  must  be  attributed    primarily  to 
volatility  of  caregiver  behavior,  rather  than  to  observer 
differences. 
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Table  4.2 

STABILITIES  OF  ADULT-FOCUS  DEPENDENT  MEASURES 

Day-to-Day  Fall-to-spring 

Stability  Stability 

Adult-Focus  (Spring  1977;  (Phase  III;  N=145 

Codes/Constructs  N=203  caregivers)  caregivers) 

TO  WHOM  Codes 

To  one  child  .28  .26 

To  small  group  .24  .36 

To  medium  group  .31  .26 

To  large  group  .40  .40 

To  other  staff  .40  .14 

To  environment  .06  .24 

WHAT  Codes 

Commands  .13  ,14 

Corrects  .06  .07 

Questions  .16  ,27 

Responds  .14  .49 

Praises  .20  .47 

Comforts  .19  .07 

Instructs  .07  .36 

Observes  .32  .38 
Adult-related 

activity  .25  .36 
Center-related 

activity  .06  .26 

Constructs 

Management  .14  .27 

Social  .22  .37 
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Pall-to-spring  stabilities,  shown  in  the  second 
column  of  Table  4.2,  were  with  a  few  exceptions  approxi- 
mately as  high  as  day-to-day  stabilities  and  in  a  few  cases 
were  substantially  higher.     (Correlations  in  the  table  are 
baaed  on  a  sample  of  145  caregivers  observed  in  both  fall 
and  spring.     Scores  for  each  caregiver  were  averaged  over 
two  days  Of  observation  at  each  time  point.)    The  fact  that 
long-term  stabilities  do  not  deteriorate  suggests  that  there 
is  a  measure  of  continuity  in  caregiver  behavior  as  measured 
by  the  AFI.     In  some  cases  this  continuity  is  partially 
obscured  by  short-term  fluctuation. 

The  overall  pattern  of  stability  coefficients  is 
mixed.    Where  there  are  low  stabilities  at  both  points,  this 
suggests  that  the  immediate  situation  controls  behavior, 
rather  than  any  characteristic  of  the  caregiver.     Low  sta- 
bilities in  the  short  term,  together  with  higher  long-term 
stabilities,  suggest  that  there  are  general  and  long-lasting 
caregiver  styles,  but  that  these  may  be  hard  to  detect  over 
a  short  span  of  observation  because  day-to-day  changes  in 
the  situation  inhibit  expression  of  the  caregiver '  s,  usual 
dispositions.     Altogether,  the  results  of  the  stability 
analyses  suggest  that  much  of  the  variance  in  the 
measures  of  caregiver  behavior  may  be  linked  to  situational 
fluctuation  and  therefore  may  not  be  systematically 
related  to  the  policy  measures,  which  reflect  enduring 
features  of  the  day  care  setting.     There  is  enough  stability 
to  warrant  investigation  of  relationships  to  the  policy 
variables;  however,  instability  limits  the  strengths  of  the 
relationships  that  can  potentially  be  found. 

Neither  interobserver  agreement  nor  stability 
over  time  conveys  all  of  the  information  needed  to  judge 
the  suitability  of  AFI  measures  for  use  in  effects  analyses. 
What  matters  is  how  well  those  measures  characterize  care- 
givers, classes  or  centers  when  appropriately  averaged,  m 
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more  technical  terms,  what  matters  is  the  relative  impor- 
tance of  different  sources  of  variance  in  caregiver,  class 
and  center  means  for  each  of  the  AFI  measures.     The  more 
variance  that  is  linked  to  the  unit  of  analysis  itself 
(caregiver,  class  or  center),  the  more  dependable  is  the 
measure  for  that  unit.     The  more  variance  that  is  linked  to 
other  factors,  including  but  not  limited  to  observer  dis- 
agreement and  fluctuation  in  caregiver  behavior,  the  less 
dependable  is  the  measure  as  a  descriptor  of  the  chosen 
unit. * 


To  assess  the  relative  importance  of  the  major 
potential  determinants  of  AFI  scores,  a  variance  components 
analysis  was  performed  (Singer,  Affholter  and  Goodrich, 
1978).     The  analysis  revealed  that  for  almost  all  of  the 
AFI  codes  and  constructs,  the  occasion  of  observation  was 
the  major  determinant  of  variation,   followed  (usually  at  a 
distance)  by  the  caregiver.     Center,  class,  observer  and 
site  all  were  relatively  minor  determinants.     Thus,  subject. 


*Note  that  a  behavioral  profile  for  a  particular  caregiver, 
calculated  by  averaging  scores  across  different  occasions 
of  observation,  is  not  free  of  distortion  due  to  observer 
disagreement  and  behavioral  fluctuation  from  occasion  to 
occasion.     To  understand  this  point,  consider  the  case 
in  which  scores  recorded  by  two  different  observers  are 
averaged  to  yield  summary  scores  for  a  caregiver  whom  both 
have  observed.     (For  simplicity,  ignore  the  effects  of 
fluctuation  over  time.)     Averaging  cancels  out  differences 
in  perspective  between  the  particular  observers,   each  with 
his  or  her  own  biases,  which  tend  to  push  "true"  scores  of 
caregivers  up  or  down.     The  "average  bias"  of  the  partic- 
ular pair  of  observers  will  in  general  deviate  markedly 
from  the  average  bias  of  this  hypothetical  universe  of 
observers.     Thus  average  recorded  scores  have  (at  least) 
two  components — one  linked  to  the  caregiver,  and  the  other 
to  the  average  bias  of  the  observer  pair.     By  an  analogous 
argument,   scores  averaged  across  a  few  occasions  of  obser- 
vation inc-ade  a  conponent  due  to  the  average  bias  inherent 
in  those  occasions.     Similarly,  class  scores  produced  by 
averaging  across  caregivers  have  a  caregiver  component,  as 
well  as  observer  and  occasion  components,  and  center  scores 
produced  by  averaging  across  classes  have  class,  caregiver, 
occasion  and  observer  components. 
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to  certain  qualifications*,  the  variance  components  results 
reinforced  impressions  created  by  findings  on  interobserver 
agreement  and  stability  over  time:    Differences  in  observer 
perspective  contributed  relatively  little  to  API  scores, 
while  fluctuations  in  caregiver  behavior  contributed  heavily. 
This  outcome  is  a  common  one  in  observation  research  (Medley 
and  Mitzel,  1963)  . 

Variance  components  results  can  be  translated  into 
estimates  of  the  generalizabilities  of  API  measures  at  var- 
ious levels  of  aggregation  (caregiver,  class  and  center). 
Ceneralizabilities  may  be  interpreted  as  proportions  of 
variance  in  aggregate  scores  (e.g.,  class-average  scores) 
that  are  linked  to  the  uni-.  in  question  (e.g.,  the  class) 
and  not  to  other  factors.    Generalizabilities  of  selected 
API  constructs  and  codes  are  shown  in  Table  4.3.     The  table 
shows  that  API  measures  dependably  characterize  caregivers 
but  are  less  dependable  as  descriptors  of  classes  or  centers. 
In  some  cases,  particularly  for  the  summary  constructs, 
dependabilities  at  the  caregiver  level  are  strikingly  high. 
The  results  have  two  obvious  and  important  implications: 
first,  that  the  caregiver  is  the  appropriate  unit  of  analy- 
sis for  investigating  effects  of  the  policy  variables,  and 
second,  that  the  study's  ability  to  detect  relationships 
between  policy  variables  and  caregiver  behavior  is  substan- 
tial, particularly  for  the  classroom  composition  variables, 
which  are  also  measured  with  high  reliability. 


The  analysis  was  necessarily  structured  in  such  a  way  that 
the    occasion-  component  was  indistinguishable  from  random 
measurement  error.    Also,  partly  because  only  one  caregiver 
was  observed  in  many  classes,  and  partly  because  of  certain 
assumptions  built  into  the  statistical  procedure,  it  wis 
"P3"te  variation  due  to  classes  from  that 
n^or^^^^f  ""givers.    Thus  the  analysis  tended  to 

nf  the  importance  of  "occasion"  and  understate  that 

0£  Class.  These  biases  had  no  substantive  effect  on  the 
usefulness  of  the  measures.  on  tne 
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Table  4.3 

GENERALIZABILITIES  OF  SELECTED  ADULT-FOCUS  MEASURES 


Generalizability  at  Indicated 
Level  of  Aggregation 

Adult-Focus 

Codes/Constructs  Center  Class  Caregiver 
TO  WHOM  Codes 

To  Small  Group  .21  .23  .76 
WHAT  Codes 

P^^aises  .28  .24  .78 

Observes  .23  .33  .79 

Adult-Related  Activity  .24  .44  .70 

Constructs 

Management  .12  .34  .96 

Social  Interaction  .18  .44  .92 
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Selection  of  independent  Measures 


Choice  of  independent  variables  was  motivated  by 
a  basic  value  decision  made  at  the  outset  of  the  study  to 
focus  attention  on  those  aspects  of  the  quality  of  day  care 
that  bear  directly  on  the  child.     In  effect,  it  was  assumed 
that  the  primary  goal  of  day  care  purchasing  standards  is  to 
ensure  the  best  possible  environment  for  the  most  children. 
Other  goals  of  day  care— e.g.,  freeing  parents  to  work, 
serving  as  a  vehicle  for  delivery  of  social  services  to 
parents,  employing  low-income  people  as  staff  and  foster- 
ing their  development  as  prof essionals— were  recognized  as 
legitimate  and  important  but  were  not  central  to  the  study. 

As  a  consequence,  in  selecting  regulatable  center 
characteristics  for  intensive  investigation  as  independent 
variables,  priority  was  given  to  those  characteristics 
deemed  most  likely  to  affect  children's  daily  experiences, 
namely  the  composition  of  the  classroom  (principally  group 
size  and  staff/child  ratio)   and  the  qualifications  of  care- 
givers (education  and  experience),     other  center  character- 
istics  (space,  equipment  and  materials,  center  philosophy 
and  curriculum,  director  qualifications,  stability  of  care- 
giver/child  relationships,  availability  of  nutrition  and 
health  services,  availability  of  other  ^supplementary  ser- 
vices and  specialists,  opportunities  for  parent  involve- 
ment) were  examined  in  descriptive  and  exploratory  fashion 
to  determine  whether  any  appeared  to  have  major  effects 
on  classroom  processes  and  child  outcomes.     However,  in 
light  of  preliminary  results  which  suggested  that  most 
of  these  variables  had  minimal  effects  on  the  particular 
outcome  measures  chosen,  only  a  few  of  the  variables  were 
Investigated  further,  and  then  only  to  a  limited  extent. 
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Two  types  of  independent  variables  were  tested  in 
the  effects  analyses:     background  variables  (such  as  age, 
sex  and  race  of  children,  and  socioeconomic  characteristics 
of  families  and  of  the  community  served  by  the  particular 
center)  and  policy  variables  (i.e.,  center  characteristics 
subject  to  regulatory  control).    While  background  variables 
are  unregulatable  and  therefore  not  of  direct  policy  rele- 
vance, their  effects, had  to  be  taken  into  account  in  assess- 
ing the  effects  of  the  policy  variables. 

Information  on  background  characteristics  of 
children  and  their  families  was  gathered  through  interviews 
with  parents.     Background  information  included  family  in- 
come, sources  of  income,  parents'  education  and  occupation, 
length  of  parents"  employment,  number  of  siblings  and  number 
of  adults  living  in  the  house.     Age,  sex  and  race  of  chil- 
dren were  verified,     in  addition,  census  data  were  used  to 
provide  background  information  on  demographic  characteris- 
tics of  the  community,  chiefly  its  socioeconomic  and  racial 
composition, 

A  set  of  variables  that  described  the  socioeconomic 
characteristics  of  the  children's  families  were  aggregated 
from  the  child  level  to  the  class  level  as  potential  inde- 
pendent measures.     These  included  mean  family  income,  mean 
mother's  education,  mean  proportion  of  single  parents,  mean 
number  of  children  under  12  in  the  home,  and  mean  proportion 
of  black  children  in  the  class.     The  simple  correlations  of 
these  demographic  variables  with  the  dependent  measures  in- 
dicated some  significant  relationships,  particularly  with 
the  TO  WHOM  codes.     Since  the  five  demographic  variables 
were  strongly  intercorrelated,   (Table  4,4)  and  because  five 
SES  covariables  was  a  large  set  to  enter  into  the  regression 
analyses  as  independent  measures,  a  clustering  was  completed 
to  represent  the  average  socioeconomic  status  of  the  children 
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Table  4.4 

INTERCORREUiTION  OF  SOCIOECONOMIC 
MEASURES  IN  NDCS  CLASSROOMS,   SPRING  1977* 


Mother's  Education  .80 

Proportion  of  Mothers 
with  College  Degree 

Family  Income 

Proportion  of 
Single  Parents 

Number  of  children 
Under  12 

Proportion  of 
Black  Children 


.72  -.55  -.43  -.25 

•58  -.33  -.24  -.31 

-.66  -.42  -.43 

.36  .39 

.31 


*A11  correlations  were  significant  at  p<.05. 
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in  each  class.     The  five  variables  were  factor  analyzed  and 
a  principal  component  factor  score  was  assigned  to  each 
class.     This  principal  component,   labeled  CLASS  SES,  typi- 
cally fell  between  -1  and  1,  with  positive  scores  indicat- 
ing higher  SES-     The  principal  component  was  the  main  SES 
cwariable  in  the  regression  equations.     Caregiver  race 
also  was  used  as  a  covariable. 

The  major  policy  variables  exeimined  in  the  NDCS 
fell  into  two  categories — those  relating  to  classrocxn  canpo- 
sition  and  those  relating  to  caregiver  qualifications.  Three 
variables  fell  under  the  rubric  of  classroom  composition; 

•  number  of  caregivers,  defined  as  the  total 
number  of  caregivers  present  in  or  assigned 
to  a  classroom; 

•  group  size,  defined  as  the  total  number  of 
children  present  in  or  assigned  to  a  class 
or  to  a  principally  responsible  caregiver;* 
and 

•  staff /child  ratio,  defined  as  the  number 
of  caregivers  divided  by  group  size. 

Information  on  caregiver  qualifications  was 
gathered  fran  interviews  with  caregivers.  Caregiver 
qualifications  variables  consisted  of  total  years  of 
formal  education,  presence  or  absence  of  child-related 
education/ training ,    (also  called  "specialization )  and  day 
care  experience  (both  prior  to  current  job  and  time  in 
current  center) , 


*In  all  but  a  few  NDCS  centers,  groups  of  children  were 
assigned  to  particular  rooms,  supervised  by  a  single  care- 
giver or  several  caregivers.     In  a  few  "open  classroan" 
centers,  however,   very  large  numbers  of  children  (approach- 
ing 100  in  extreme  cases)  were  present  in  a  single  large 
room.     Even  in  such  centers,  children  clustered  around 
individual  caregivers  or  small  teams  dispersed  around  the 
room,  though  children  were  often  free  to  move  from  group 
to  group.     Numbers  of  children  in  these  smaller  groups 
constituted  the  group  size  used  for  NDCS  analytic  purposes. 
Similarly,  numbers  of  caregivers  were  the  number  of  adults 
in  physically  separated  groups. 


Information  on  the  classroom  composition  variables  was 
gathered  by  two  methods,  one  based  on  schedule  or  roster 
data  and  the  other  on  direct  observation,  i.e.,  as  part  of 
the  AFI-     Schedule-based  and  observation- based  measures  of 
classroom  composition  were  not  always  in  close  agreement - 
Differences  between  the  two  were  primarily  attributable  to 
two  phenomena — absenteeism  and  merging  of  classes.  Because 
observations  capture  the  group  configurations  actually 
experienced  by  the  child  and  because  they  automatically . take^ 
account  of  absenteeism  and  merging,  observation-based 
measures  were  used  in  all  the  analyses  reported  in  this 
volume.*    However,  because  of  the  importance  of  these  issues 
for  monitoring  and  enforcement,  comparative  investigations 
of  the  two  types  of  measures  were  conducted  and  are  reported 
elsewhere  (Bache,  1980). 


Three  distinct  sets  of  observation  data  were  collected. 
One  set  was  collected  on  a  regular  basis  by  NDCS  staff 
employed  full-time  at  each  center  during  Phases  II  and  III; 
this  set  was  used  in  analyses  of  non-behavioral  data.  A 
second  set  of  counts  was  made  in  conjunction  with  behavior- 
al observations  of  caregivers,  and  a  third  in  conjunction 
with  observations  of  children;  these  counts  were  used  in 
the  corresponding  behavioral  analyses. 


45 


CHAPTER  FIVE;     EFFECTS  OF  THE  POLICY  VARIABLES 


The  discussion  that  follows  focuses  on  the  non- 
experimental  study  of  naturally  existing  relationships  between 
the  policy  measures  and  caregiver  behavior,   in  the  49-centers. 
The  results  of  the  ratio  experiment  in  these  49  centers  are 
briefly  presented  first,  but  the  essentially  null  effects 
reduce  the  need  for  elaboration.     The  results  of  the  APS 
study  are  not  discussed  in  this  chapter  but  in  a  separate 
paper  in  this  volume  (Goodrich,   1980) .     In  most  cases,  the 
discussion  of  results  includes  only  those  significant  at  p. 05. 
The  tables,  however,  report  significance  levels  at  least  up 
to  p. 15.     When  nearly-signif icance  results  appear  to  be  part 
of  an  overall  pattern,  the  results  are  discussed  as  part  of  a 
trend  or  tendency. 

Experimental  Study  of  Ratio  Effects 

As  described  earlier,  the  effects  of  staff/child 
ratio  were  tested  in  a  quasi-experiment  in  49  of  the  centers. 
The  question  tested  was  whether  caregivers  in  high-ratio 
classrooms  with  an  experimentally  induced  increase  in  ratio 
behaved  differently  when  compared  with  caregivers  in  either 
untreated  low-ratio  or  untreated  high-ratio  classrooms.  In 
a  series  of  one-way  analyses  of  variance  comparing  caregivers 
in  the  three  types  of  classrooms,  there  were  few  detectable 
effects  of  ratio.     These  were  not  strong  beneficial  effects 
for  higher  ratios  in  terms  of  caregiver  behavior. 

Lead  teachers  and  aides  were  examined  separately. 
For  lead  teach  ers  ( Table  5.1),  only  one  code  showed  a 
significant  overall  difference  in  frequency  across  the  three 
groups.     The  frequency  of  RESPONDS  was  lower  in  naturally 
high-ratio  centers  than  in  the  treated  high-ratio  and 
comparison  low-ratio  centers,  which  did  not  differ  from 
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Table  5.1 

Frequency  ,f  Lead  Teacher  Behavior  in  tk,,.        Trntrnl  G 


AFI  Measures 
IwHAT  codes 

1    Natural  Low 
1  Ratio 
lclassrooms(n=32l 

1  Treated  High 
1  Ratin 

lclassrooms(n=33) 

1  Natural  High 
1  Ratio 
lclassrooms(n=42) 

[Significance* 

1  MANAGE 
1  Command 
1  Correct 

1  .16 
1  .09 

1  .07 

1  .16 
1  .09 

1  07 

1  .14 
.09 
.05 

1   SOCIAL  INTERACTION 

.22 

1  .24 

.23 

1  Direct  Question 
1  Respond  1 
1  Instruct  1 
1  Comfort  1 
1  Praise  I 

.05 
.02 

.09  1 
.01  1 

.04  1 

.06  1 
.0?  1 

.09  1 
.01  1 
.05  1 

.06 

.01  j 
.09  j 
.02  1 
.05  1 

.15 
.05 

1  Adult  Activity  | 
1  Center  Activity 

1  Observes  | 

.07  1 
.38  1 

.17  1 

.07  1 
.38  1 

.16  1 

.05  1 
.40  1 

.18  1 

.15 

ITO  WHOM  codes  | 
1  To  1  child  1 
1  To  small  group  | 
1  To  med.  or  Ig.  group! 
1  To  other  staff  I 

.33  i 
.09  1 
.19  1 
.06  1 

.34  i 
.09  1 
.21  1 
.07  1 

.35  1 
.09  i 
.20  1 
.05  1 

.15  1 

p  reported  only  if  <.15 


each  other.     There  also  was  a  tendency  toward  a  lower 
frequency  of  CORRECTS  in  the  naturally  high-ratio  centers. 
These  results  clearly  are  not  attributable  to  the  experimen- 
tal manipulation,  but  to  other  characteristics  of  naturally 
high-ratio  centers.     For  aides  (Table  5.2),  no  differences, 
were  significant,  although  one  tendency  potentially  attribu- 
table to  the  ratio  manipulation,  appeared:     Aides  in  treated 
high-ratio  classrooms  and  naturally  high-ratio  classrooms 
de^'oted  less  attention  to  the  physical  environment  than  did 
those  in  low-ratio  classrocms. 


Regression  Model  Construction 


The  goal  of  the  main  effects  analyses  of  the 
Phase  ll_  data  was  to  define  the  relationships  between  each 
independent  measure  and  caregiver  behavior,  and  to  assess 
how  well  the  set  of  policy  variables  predicted  caregiver 
behavior.     Simple  correlations  alone  were  not  adequate  to 
test  the  relationships,  since  there  was  some  confounding 
among  the  policy  variables,  e.g.,  ratio  and  group  size.  In 
addition,  it  was  important  to  assess  the  caubined  effect  on 
caregiver  behavior  cf  a  set  of  policy  variables.     Data  was 
analyzed  by  multiple  regression,  using  different  combina- 
tions of  the  polIvTy  variables  that  were  selected  to  mini- 
mize the  confounding  within  each  set  and  at  the  same  time, 
to  maximize  t\\  chancer  of  statistically  separating  the 
effects  of  the  policy  variables. 

.-s  noted  earlier,  ten  independent  measures  were 
the  foci.  -     f  the  API  effects  analyses.     Eight  were  policy 
variabli^ii      observed  group  size,  number  of  staff,   ratio  of 
staff     o  ch^^dren,  carea7.v?:>r  years  of  education,  child- 
relate-  ^a.ic  ; -.ion/trai  -.  unw   v  specialization) ,  previous  day 
car^  experience,  experx^ince  in  current  center,  and  age. 
T\^^   were  covariables— caregiver  race,  and  the  construct 
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Table  5.2 

frequency  of  Aide  Behavior  in  Three  Ratio  Treatment  Groups  -<;pr<n.  API 


API  Measures 
IWHAT  codes 
I 

MANAGE 
Command 
Correct 

SOCIAL  INTERACTION 

Direct  Question 

Respond 

l!i3?.ruct 

Comfort 

Praise 

Adult  Activity 
Center  Activity 

Observes 

TO  WHOM  codes 
To  1  child 
To  small  group 
To  ined.  or  Ig,  group 
To  other  staff 
To  environment 


Natural  Low 
Ratio 
classrooms(n=13) 


.12 
.06 
.06 

.19 

.05 
.02 
.07 
.02 

.04 

.03 
.42 

.24 


.31 
.09 
.20 
.08 
.06 


Treated  High 
Ratio 
classrooms(n=20) 


.13 
.07 
.06 

.24 

.07 
.02 
.08 
.01 
.06 

.02 
.35 

.25 


.36 
.11 
.22 
.06 

.06 


Natural  High 
Ratio 
classrooms(n=20) 


.15 
.08 
.06 

.19 

.06 
.02 
.06 
.01 
.04 

.04 

.38 

.23 


.35 
.14 
.16 
.06 
.04 


Significance* 


.15 


.15 


.15 
.15 


.10 


p  reported  only  if  <.15, 
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representing  socio-economic  status  of  the  children  in  each 
class  (class  SES) •     The  ten  were  not  entered  as  a  single 
group  in  any  of  the  regression  equations  for  two  reasons, 
first,  because  the  set  was  too  large,  relative  to  the  sample 
sizes  of  the  data  sets,  but  more  importantly  because  of 
problems  of  multicollinearity  among  the  measures • 

There  was  some  substantial  confounding  among  the 
independent  measures,  both  within  types  of  measures  (e.g., 
the  classroom  composition  variables)  and  across  types 
(e.g.,  the  classroom  composition  variables  and  caregiver 
characteristics)    (Table  5.3).     Three  pairs  of  related 
measures  were  highly  correlated:     GROUP  SIZE  and  RATIO, 
EDUCATION  and  SPECIALIZATION,  and  CAREGIVER  RACE  and  CLASS 
SES.     The  pattern  of  confounding  affected  the  strategy 
used  in  the  regression  analysis. 

Stepwise  regressions  were  used.     However,  only 
the  final  step  of  the  regressions  is  reported  in  the  tables 
of  results,  because  there  was  no  theoretical  basis  for 
predicting  or  interpreting  the  order  of  entry  of  the 
regressors  the  coefficients  presented  in  the  tables  are  not 
affected  by  order  of  entry  of  the  independent  measures. 

Five  regression  models  were  tested  (Table  5.4). 
MODEL  I  entered  two  policy  variables  which  were  not  con- 
founded:    GROUP  SIZE  and  CHILD-REIATED  SPECIALIZATION. 
In  MODEL  II,   RATIO  was  entered  along  with  SPECIALIZATION. 
MODEL  III  entered  the  variables  for  EXPERIENCE  IN  CURRENT 
CENTER,  GROUP  SIZE,   and  SPECIALIZATION.     In  MODEL  IV,  YEARS 
OF  EDUCATION  instead  of  SPECIALIZATION  was  entered  with 
GROUP  SIZE,  to  compare  effects  for  education  and  special- 
ization.    Finally,   in  MODEL  V,  GROUP  SIZE  and  RATIO  were 
entered  with  SPECIALIZATION  to  test  their  combined  effect 
and  to  examine  what  happened  to  the  separate  effects  of 
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Tttle  5.3 


Intercorrelatlons  of  Independent  Measures 
In  the  49-Center  Swpla^ 

(n^7  Teachers  and  n-«  Aides)  ^ 


Spoctalization 

Years  of  Uucation 

Pnvlous  Day  Care 
Experience 

current  Center 
Experience 

API  Gtwp  Size 

An  Ratio 

Oiregiver  Race 

Uasa  SES 


Years  of 

Specialization  Education 


.38** 


.33** 


.23 


-.25 


Previous 
Daycare 
Experience 


Current 
Center 
Experience 


..22»* 


-.25 


API 
Gtoif* 
Size 


-.24* 


-.65** 

-.27 


API 
Ratio 


.32** 
.41** 
-.46** 


Caregiver  Class 
Race  SES 


.32** 


.56** 


.48** 


1  reported  correlations  have  |K.15.  torrelatlons  significant  at  p<.05  have  one  asterisk;  those  with  p<.01  have  two  asteriska. 
irrelatlons  above  the  diagonal  are  for  teachers;  those  below  the  diagonal  are  for  aides. 
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Table  5.4 

Outline  of  AFI  Exploratory  Regressions 


Model  Covariables 

I        Class  SES 

Caregiver  Race 


Policy  Variables 

Group  Size 
Specialization 


Purpose 

•  Estimate  individual  and  combined  effects  of  GROUP  SIZE 
and  SPECIALIZATION 


Class  SES 
Caregiver  Race 


Ratio  0  Estimate  individual  and  combined  effects  of  RATIO  with 

Specialization  SPECIALIZATION 


Class  SES 
Caregiver  Race 


Group  Size 
Specialization 
Experience  in 
Current  Center 


•  Estimate  effects  of  caregiver  EXPERIENCE 


Class  SES 
Caregiver  Race 

Qass  SES 
Caregiver  Race 


Group  Size  •  Estimate  effects  of  YEARS  OF  EDUCATION,  to  compare 

Years  of  Education     with  effects  for  specialization  in  Model  I 


Group  Size 
Ratio 

Specialization 


•  Estimate  combined  effects  of  RATIO  with  GROUP  SIZE 


each  when  entered  with  a  correlated  variable.  Two 
covariables— CAREGIVER  RACE  and  a  measure  of  CLASSROOM 
SOCIOECONOMIC  STATUS  (SES)  were  entered  in  every  model. 

The  rationale  for  using  these  sets  of  independent 
measures  in  this  manner  was  based  primarily  on  the  pattern 
of  confoundings  among  the  measures.     For  the  three  pairs  of 
related  measures  which  were  highly  intercorrelated  (RATIO 
and  GROUP  SIZE,   CAREGIVER  SPECIALIZATION  and  YEARS  OF  EDU- 
CATION, CAREGIVER  RACE  and  CLASS  SES),  both  variables  in 
a  pair  could  not  be  entered  simultaneously  in  the  regres- 
sion equations  if  separate  estimates  of  their  effects  were 
of  interest.     Therefore,  a  different  strategy  had  to  be 
adopted . 

In  the  case  of  CAREGIVER  RACE  and  SES  OF  THE 
CLASS,  there  was  no  reason  to  try  to  separate  their  effects, 
so  the  two  measures  were  entered  simultaneously  into  all 
regressions,  and  only  their  combined  effect  was  examined. 
We  assumed  that  there  was  a  "package"  of  caregiver  and  child 
background  factors  that  was  likely  to  be  related  to  care- 
giver behavior  and  that  should  be  taken  into  acount.  These 
variables  were  not  correlated  with  any  of  the  policy  vari- 
ables except  years  of  education.     Therefore,  the  effects 
of  the  policy  measures  could  be  measured  accurately  without 
entering  the  covariables.     However,  they  were  related  to 
caregiver  behavior  and  for  that  reason  were  entered  for 
purposes  of  prediction. 

Separate  estimates  of  the  effects  for  GROUP  SIZE 
and  RATIO  were  of  interest.     Therefore,   in  four  of  the  five 
regression  models.  GROUP  SIZE  and  RATIO  were  entered  sepa- 
rately.    In  the  fifth  orvdel,  they  were  entered  together. 
Although  they  were  highly  confounded  in  the  AFI  sample, 
(r  =  .46  for  teachers,    .65  for  aides).     GROUP  SIZE  and  RATIO 
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were  related  to  somewhat  different  sets  of  caregiver 
behaviors.     That  is,   the  GROUP  SIZE  effect  and  the  RATIO 
effect  clearly  were  confounded  but  not  synonymous,  suggest- 
ing that  these  two  policy  variables  should  receive  careful 
individual  examination.     Group  size  rather  than  ratio  was 
focused  on  in  most  models  for  the  sake  of  consistency  and 
cc»nparison  on  the  basis  of  findings  for  child  tests  and 
observations,   in  which  group  size  appeared  to  have  stronger 
effects.     The  regression  model  testing  both  GROUP  SIZE  and 
RATIO  showed  that  entering  both  of  the  confounded  measures 
often  produced  artifactual  effects.     These  included  both 
spuriously  high  and  reduced  effects  for  one  or  both  of  the 
measures.     For  this  reason,  the  results  of  this  regression 
model  (Model  V)  are  not  reported. 

When  examining  CHILD-RELATED  EDUCATION/TRAINING 
(SPECIALIZATION)   and  YEARS  OF  EDUCATION,   the  regression 
models  entered  the  variables  separately  but  focused  on 
SPECIALIZATION  in  four  of  the  five  models.     Simple  cor- 
relations of  these  independent  measures  with  the  dependent 
measures  were  similar  in  direction,  but  those  for 
SPECIALIZATION  were  stronger,  particularly  among  lead 
teachers.     Among  aides,  YEARS  OF  EDUCATION  was  about  as 
good  a  predictor  as  SPECIALIZATION,  but  neither  was  very 
powerful.     In  addition,  SPECIALIZATION  showed  little 
variance  among  aides.     Another  important  reason  for 
focusing  on  SPECIALIZATION  was  that  YEARS  OP  EDUCATION 
appeared  to  be  partially  or  primarily  an  SES  measure;  it 
was  correlated  with  RACE  OF  CAREGIVER,   wliile  SPECIALIZATION 
was  not.     The  regression  model  that  tested  education  was 
used  with  both  teachers  and  aides,  but  years  of  education 
had  effects  only  for  aides.     Therefore,   the  results  for 
Model  IV  are  reported  for  aides  only. 


The  caregiver  experience  variables  were  tested 
in  models  along  with  GROUP  SIZE  and  SPECIALIZATION.  They 
were  not  tested  in  models  with  RATIO  because  EXPERIENCE 
and  RATIO  were  confounded  in  the  AFI  sample.     For  both 
lead  teachers  and  aides,  only  the  results  for  EXPERIENCE 
IN  CURRENT  CENTER  are  discussed,   since  PREVIOUS  DAY  CARE 
EXPERIENCE  had  no  effects. 

In  addition  to  the  conventional  least-squares 
regression  analyses,  two  kinds  of  checks  were  done  on  the 
AFI  data  to  identify  extreme  or  atypical  cases  which  would 
alter  the  distributions  required  for  the  kinds  of  statistics 
used  in  the  analyses.     First,   scatterplots  of  the  dependent 
and  independent  measures  were  scanned  for  bivariate  outliers. 
Second,  biweighted  regressions  were  run  to  assess  the 
robustness  of  the  regression  equation  if  outliers  were 
removed.     In  biweighted  regressions,   weights  are  assigned  to 
cases  on  the  basis  of  their  deviations  ixom  the  regression 
surface.     Outliers  are  given  less  weight  and  thus  affect  the 
regression  equation  less  strongly. 

The  scatterplots  clearly  indicated  a  handful  of 
about  seven  outlier  cases.     These  cases  either  had  extreme 
values  on  the  dependent  measures  (e.g.,   65  percent  on 
OBSERVE  when  the  next  highest  value  was  below  50  percent), 
or  extremely  small  values  for  group  size.     Once  these  cases 
were  eliminated  from  the  data  set,  the  correlations  between 
the  policy  and  dependent  measures  were  redone.    Those  that 
were  significant  before  the  exclusion    ..came  stronger,  and 
some  of  the  apparently  contradictory  a..-:  or  unexplainable 
correlations  disappeared.     In  general,  however,  the  main 
effects  Of  the  policy  variables  were  not  dependent  on  the 
few  atypical  cases  with  extreme  values. 
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Further,  the  estimates  obtained  with  the  bi- 
weighted  regression  analyses  typically  were  not  substan- 
tially different  from  the  estimates  from  the  unweighted 
regressions.     Biweighted  regressions  were  done  on  the 
spring  data  separately  for  the  49-center  lead  teachers. 
The  biweighted  estimates  for  the  regressors  were  not  much 
different  from  the  unweighted  estimates.     Estimates  for 
group  size  were  virtually  unchanged  by  the  weighting, 
and  a  few  of  the  estimates  for  ratio  were  reduced. 

TV»     y-egression  models  were  investigated  separately 
for  teachc  .    Birdes,  for  caregivers  in  the  49-center  and 

APS  sample       >       ior  fall  and  spring  data.     This  report 
focuses  on  tue  spring  data  for  caregivers  in  the  49-center 
sample.     The  focus  on  spring  data  is  because  the  data  col- 
lection techniques  in  the  spring  controlled  better  for  ob- 
server effects  and  because  of  the  instability  of  caregivers' 

classroom  assignment  in  the  fall.     There  also  is  a  focus^n^  

teachers,  because  of  the  representativeness  of  the  teacher 
sample.     The  parallel  regression  analyses  done  on  the  fall 
data  and  on  the  APS  data  are  discussed  more  briefly,  with 
emphasis  on  the  consistency  of  the  findings. 

Regression  Results;     Lead  Teacher  Behavior  in  the 
49-Center  Study 

Most  of  the  findings  for  lead  teachers  that  are 
reported  below  are  based  on  a  sample  of  87  teachers.  (Of 
the  115  teachers  observed  in  the  49-center  study,  these  87 
had  no  missing  data  on  the  variables  used  as  independent 
measures  in  the  regressions.)     In  the  presentation  of  the 
regression  analyses  for  this  sample,  the  results  are  organ- 
ized around  the  major  independent  measures.     First,  findings 
for  the  group  composition  measures  (group  size  and  ratio) 
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are  discussed  for  each  of  the  dependent  measures,  followed 
by  discussion  of  findings  for  caregiver  qualifications,  and 
finally,  the  covariables.     The  discussion  is  accompanied  by 
tables  of  regression  results—one  table  for  each  of  the 
dependent  measures.     For  each  dependent  measure,  the  table 
presents  the  findings  from  all  three  of  the  regression 
models. 

Group  Composition  Measures 

Social  Interaction  (Table  5.5).     Larger  group 
sizes  tended  to  accompany  fewer  positive  social  inter- 
actions between  lead  teachers  and  children.     This  effect  is 
significant  (p  =    05)  in  the  simple  regression  of  GROUP  SIZE 
on  SOCIAL  INTERACTION    which  included  115  lead  caregivers.* 
In  the  multiple  regression  models  reported  here,   for  which 
n  =  87,  the  relationship    3  no  longer  significant,  although 
the  direction  of  the  relationship  persists. 

Among  the  component  codes  in  SOCIAL  INTERACTION, 
only  RESPOND  was  related  to  group  size  (p<.05).  Teachers 
responded  to  children  less  often  in  larger  classrooms  (Table 
5.6).     None  of  the  other  codes — QUESTION,    INSTRUCTS,  PRAISE, 
COMFORT—were  individually  associated  with  group  size  or 
ratio  (Tables  5.7-5.10). 

Management  (Table  5.11).     Staff/ child  ratio  was 
associated  with  the  amours  of  management  by  caregivers. 
Higher  staff/ child  ratios  w-ire  significantly  related  to  less 
managing  by  lead  teachers.     There  also  was  a  trend  for 
larger  group  sizes  to  accompany  more  managing  of  children  by 
the  caregiver. 

Of  the  two  component  codes  in  Management,  (Tables 
5.12  and  5.13),  only  COMMAND  was  significantly  related  to 


*This  was  reported  in  Volume  I,  Children  at  the  Center. 
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Table  5.5 

Results  of  Re(|ressions  of 
Caregiver  Behavior  Variables,  Sprinc|  1977 
(Lead  Teachers,  n=87) 

SXIAL  MACTiON 


Policy  Variables 

I    Observed  group  size 
Child-related  education/ 
training 


II    Observed  staff/child  ratio 
Child-related  education/ 
training 


III 


Observed  group  size 
Child-related  education/ 

training 
Experience  in  current  day 

care  center 


Ordinary  Least 

Squares 
Coefficient 

JL 

Signify  - 
cance 
of  F 

Simple 
Correlation 

2 

K  lor  Policy  ^ 
variables  (R^ 
with  Covariables) 

-.003 
.052 

2,02 
6.55 

.17 
.01 

ki 
.27 

no 
.08 

(.17) 

-.110 
.052 

.38 
6.45 

.54 
.01 

-,.02 
.27 

.07 

(*16) 

-.003 
.055 

1.61 
6.66 

.21 
.01 

-.14 
.27 

.09 
(.19) 

.000 

.02 

.88 

.06 

ERIC 


Table  5.6 


Results  of  Four  Regressions  of 
caregiver  Behavior  Variables " 
(Teacher-level,  n=87) 


RESPOND 


Ordinary  Least  '  n2r 

Policy  <i„  '  R  for  Policy 

variables  Coett       p     ^'"^'^fT''  ?  Variables 
  ioefficien^                         Correlation      (R^  with  Covariables) 

I  Observed  group  size  -.Ooi         s  14 
Oiild-related  educatioiV  .004        3  * 

training  ^'^^       '^^  (.32) 

II  Observed  staff/child  ratio  .on          537       45  n 

Child-related  education  .004        2*205      \&  u  '^^ 

training  ^'^^^  '^^  (.28) 

III  Observed  group  size  -.001        4.95       no  „ 
Md-related  oJucatioV  .005  J 

training  '-^^  i.35) 

aperience  in  current  day  -.0002         42       ^0  nc 

care  center  '  "'"^ 
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Table  5.7 


Results  of  Four  Regressions  of 
Caregiver  Behavior  Variables 
(Teacher-level,  n=87) 


PRAISE 


Ordinary  l£ast  R^forMicy 
"fjy  Squares  Significance       Simple  Variables 

Myjjs  Coefficient     J_       of  F        Correlation      (R^  with  Covariables) 

I    Observed  group  size 
Child-related  educatiory' 
training 

.II  Observed  staff/child  ratio 
Child-related  education/ 
training 

III  Observed  group  size 
Child-relcted  education/ 

training 
Experience  in  current  day 
care  center 


-.001 

.75 

.39 

-.09 

.04 

.013 

4.31 

.04 

.21 

(.22) 

-.026 

.23 

.63 

.00 

.04 

.013 

4.07 

.05 

.21 

(.22) 

-.001 

1.01 

.32 

-.09 

.07 

.014 

4.56 

.04 

.21 

(.25) 

-.001 

.38 

.54 

-.06 

87 
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Table  5.8 


Varl..^.s 

I    Oo'i:^:/3d  group  size 
Chile 'ivfated  educatioiv^ 
trail.' ir., 

n  Observed    r  -'child  ratio 
Child-reJot.';  f^iration/ 
train 

III  Observed 

Chlld-r?'.'''?d  «k-:icn/ 

trainirr 
ExperieriCk  in'ciirrent  day 
care  center 


Results  of  Pour  Regressions  jf 
caregiver  Behavior  variables 
(Teacher-level,  n=87) 


QUESM 


Ordinary  Least 


Squares 
Coefficient 

F 

Significance 
of  F 

Simple 
Correlation 

.0001 

.02 

.1)1 

.010 

2.08 

.15 

.19 

.022 

.134 

.72 

.06 

.010 

2.215 

.15 

.19 

.0004 

.28 

.60 

.01 

,010 

1.88 

.18 

.19 

.001 

).22 

.27 

.11 

2 

R  for  Policy 
.  V&riabl  3 
(R  with  Covariables) 

.02 


.03 
(.11) 


.05 

(.13) 
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Results  of  Pour  tVciressions  of 
Caregiver  Behavfor  Variables 
(Teacher-level,  n=fi7) 


ft)licy 


Ordinary  Least  o2 


variables  Mfid.n^      p        ..r        ........      (R^  withCovariableslI 


I    Observed  group  size 


Child-related  educatioii/         .005        3.17       .  08  18  (*05i 

training  '  ^  ' 


II  Observed  staff/child  ratio 


III  Observed  group  size 


Squares 
Coefficient 

Significance 
of  F 

Simple 
Correlation 

-.0002 

.30 

.58 

-.05 

.005 

3.17 

.08 

.18 

-.011 

.2^ 

.63 

-.03 

.005 

3.05 

.08 

.18 

-.0002 

« 

.25 

.62 

-.05 

.006 

4.11 

.05 

.18 

-.0000 

.01 

.92 

.01 

8 


R  for  Policy 
Variables 


.03 


.03 


Child-related  «iucatio!i/         .005        3.05       .08  !i8  (*05) 

training  ^  ' 


Child-related"  education/         .006        ui      !o5  .'is  ('o71 

training  ^  ' 

Bcperlence  in  current  day 
care  center 


ERIC 


T^le  5.10 

Results  of  Pour  Re(|ressiQn5  of 
caregiver  Behavior  Variables" 
ri«acher-ievel,  n=87) 

INSTWICT 


Balicy 
Variables 

Ordinary  Least 

Squares 
Coefficient 

of  F 

Simple 
Correlation 

2 

R  for  Policy 
2  Variables 
(R  with  Covariables) 

.04 

(.06) 

I    Observed  group  size 
Child-related  educatioiV 
training 

-.002 
.020 

1.59 
2.24 

.21 
.14 

-.13 
.18 

II  Observed  staff/child  ratio 
Child-related  education/ 
training 

-.111 
.021 

.96 
2.46 

.33 
.12 

-.10 
.18 

.03 

(.05) 

III  Observed  group  size 
Child-related  education 
training 

2       Experience  in  current  day 
care  center 

-.002 
.020 

.0002 

1.55 
2.05 

.01 

.22 
.16 

.94 

-.13 
.18 

.08 

.04 

(.06) 
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Results  of  Regressions  of 
Caregiver  Behavior  Variables,  Sprlnj  1977 
(Lead  Teachers,  n=87) 

 mmm  

Ordinary  I^ast        signifi-  for  Eblicy 

Squares  cance       Simple  V&riables  (R^ 

Policy  variables  Coefficient   2.  Correlation      with  Covariables) 

.03 
(.06) 


I 

observed  group  size 

.002 

2.72 

.10 

.17 

Child-related  educatioiV 

-.003 

.05 

.83 

-.02 

training 

II 

Observed  staff/child  ratio 

-.347 

9.12 

.003 

-.30 

Child-related  educatior\/ 

.002 

.02 

.90 

-.02 

training 

III 

Observed  group  size  s 

.002 

1.37 

.25 

.17 

Child-related  educatioq/ 

-.003 

.05 

.83 

-.02 

training 

Experience  in  current  day 

-.003 

1.77 

.19 

-.20 

.09 
(.12) 


.05 


care  center 
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•Kible  5.12 

Results  of  Four  Regressions  of 
caregiver  Behavior  Variables 
(Teacher-level,  n=87) 

CORRECT 

ordinary  Uast  ^2^^^^^ 

CoeSent       F  c'T.  ,2 
  ,,Loetncient^_   j_   ...  ofF        Correlation      (R^ with Covariables) 

I  Observed  group  size  .ool        i.oo       .32  M  ni 
Child-related  educatioa/        -.010        1.56       .21  -1 

training  I*"'' 

II  Observed  staff/child  ratio       -.122         3.45       .07  -  ig 

Oiild-related  edu:atio^        -.008        1.22       .27  -a  1 

training 

III  Observed  group  size  .001         .55       .45  09 

Oiild-related  aiucatioq/     .   -.010        1.48       .23  .*  ,Z 

training  ^' 

Dtperience  in  current  day        -.001         .27       .60  -12 
care  center 


T^ble  5.13 


Results  of  Four  Regressions  of 
Caregiver  Behavior  Variables 
(Teacher-level,  n=87) 

com 


vSes  cf^^.       .  S^^P^^  7  variables 

variflpies  Coefficient       ?         nfv         nA.-^ULj.-  m2..o^_^.,. 


I    ObservaJ  group  size  ,,,,  ,„ 

Child-related  education/         .007         .63       4^  n  ,  ,c 


training 


training 

<j\   III  Observed  group  size 
Child-related  education 

training 
Btperience  in  current  day 

care  center 


Squares 

D 

r 

Significance 
of  F 

Simple 
Correlation 

.002 

3.26 

.08 

.19 

.007 

.63 

.43 

.11 

-.224 

10.63 

.002 

-.32 

.010 

1.62 

.21 

.11 

.001 

1.56 

.22 

.19 

.007 

.61 

.44 

.11 

-.002 

3.01 

.09 

-.22 

(.06) 


II  Observed  staff/child  ratio  ,,,,,       .uu^  .3,  „ 

Child-related  education/         .010        1.62        ?l  '11  .  u 


(.14) 


(.09) 
(.09) 


ERIC 


the  group  composition  measures.     Teachers  did  less  commanding 
in  classrooms  with  higher  staff/ child  ratio.     There  also  was 
a  tendency  for  more  commanding  in  large  classrooms  and  for 
teachers  in  higher  ratio  classrooms  to  do  less  correcting. 

Observe  (Table  5.14).     The  amount  of  time  that  a 
teacher  spent  observing  but  not  actively  involved  with  children 
was  strongly  related  to  both  the  number  of  children  and  the 
staff/child  ratio  in  the  classroom  (p<.01).     Lead  teachers 
in  larger  classrooms  tended  to  do  more  observing;  conversely, 
teachers  in  higher  ratio  classrooms  tended  to  do  less 
observing » 


Attention  to  One  Child;  Small,  Medium,  and  Larc^e 
Grougs  (Tables  5.15-5.18).     Group  size  was  a  strong  predictor 
of  how  caregivers  distributed  their  attention  in  the  class- 
room.    The  number  of  children  with  whom  the  lead  teacher 
interacted  was  sharply  related  to  group  size.     As  group  size 
increased,  teachers  spent  significantly  less  time  with  small 
(2-7)  and  medium  (8-12)  groups  and  more  time  with  large 
groups.     The  fact  that  larger  group  size  meant  less  time  with 
small  and  medium  groups  of  children  and  more  time  with  larger 
groups,  suggests  that  large  groups  tended  not  to  be  broken 
into  smaller  activity  subgroups. 

Staff/child  ratio  also  was  strongly  related  to  the 
number  of  children  with  whom  the  teacher  interacted.  Lead 
teachers  in  higher  ratio  classrooms  spent  significantly  more 
time  with  small  groups  of  children  and  less  time  with  medium 
and  large  groups.     (They  also  spent  more  time  with  other 
staff,  as  discussed  below.) 

Non-Child  Activities;     Center- Related  Activity. 
Attention  to  Staff,   and  Adult- Related  Activity  (Tables 
5.19-5.21).     Only  staff/child  ratio,  not  group  size,  was 
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Me  5.14 


Results  of  Regressions  of 
Caregiver  Behavior  Variables,  Spring  1977 
(Lead  Ifeachers,  n=87) 


OBSERVE 


Ordinary  Ifiast  Signifi-  r2  for  policy 

r^u  „  ^^^^^            cance       simple  V&riables  (R^ 

Mficisnt   X    iLL  Correlation      with  Covariables) 

I    Observed  group  size  ,006      10.11     .002  .32  10 

Qiild-related  edicatioq/  -.022       1.56     .22  -.11  ('26) 

training 

:    Observed  staff/child  ratio  -.386       6.35     .01  -.28  07 

Child-related  education/  -.014        .61     .44  -.11  ('.23) 

training 

III  Observed  group  size  .006       9.18     .003  .32  11 

Qiild-related  aiucatior^  -.021       1,32     .25  -.11  ('27) 

training 
aperience  in  current  day 
care  center 


.006 

10.11 

.002 

.32 

-.022 

1.56 

.22 

-.11 

-.386 

6.35 

.01 

-.28 

-.014 

.61 

.44 

-.11 

.006 

9.18 

.003 

.32 

-.021 

1,32 

.25 

-.11 

.000 

.01 

.94 

-.04 

1 

95 

ERIC 
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Table  5.16 


Policy  Variables 

I  Observed  group  size 
Child-related  education/ 

training 

II  Observed  staff/child  ratio 
Child-related  education/ 

training 


III  Observed  group  size 
Child-related  educatioiV 

training 
Experience  in  current  day 

care  center 


Results  of  Re<|iressions  of 
Caregiver  Behavior  Variables,  Spring  1977 
(Lead  Teachers,  n=87) 

AmiTIOM  TO  SMALL  (2-7)  GROUPS 


Ordinary  Least 

Squares 
Coefficient 


-.004 
.009 


.345 
.001 


.004 


Signifi- 

cance 

Simple 

of  F 

vUtLcla lion 

^41 

.01 

-.29 

.40 

.53 

7.56 

.007 

.29 

.01 

.02 

6.25 

.02 

-.29 

.06 

.81 

.02 

2.59 

,11 

.23 

2 

R  for  Policy 

Variables  {R^ 
with  Covariables) 

.10 

(.11) 


(.09) 


.13 

(.14) 


9? 
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■able  5.17 


Policy  Variables 

I  Observed  group  size 
Child-related  edxation/ 

training 

II  Observed  staff/child  ratio 
Child-related  education 

training 

III  Observed  group  size 
Child-related  educatiorv^ 

training 
Eicperiexe  in  current  day 
care  center 


Results  of  Reciressions  of 
Caregiver  Behavior  Variables,  Spring  1977 
Tt«ad  Teachers,  n=87) 

ATTOION  TO  MEDIUM  GROUPS 


Ordinary  Least 

Soiwrp<; 

Coefficient 

Signifi- 
cance 
of  F 

Simple 
Correlation 

-115 
-.029 

5.66 
2.34 

.02 

.13  ■ 

**•  i- J 

-.444 
-.026 

7.78 
1.99 

.007 
.16 

••31 
••13 

-.006 
-.018 

9.80 
.96 

.002 
.33 

*il3 

-.009 

10.37 

.002 

-.23 

for  ft)licy 
Variables  (R 


2 


with  Covariablesl 

.09 

(.14) 


.10 
(.16) 

.18 
(.23) 
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Table  5.18 


Policy  Variables 

I  Observed  group  size 
Child-related  education/ 

training 

II  Observed  staff/child  ratio 
Child-related  education/ 

training 

III  Observed  group  size 
Qiild-related  education/ 

training 
Experience  in  current  day 
care  center 


Results  of  Regressions  of 
Caregiver  Behavior  Variables,  Spring  1977 
(Lead  Teachers,  n=87) 

ATTENTION  TO  IAR3E  (13+)  GROUPS 

Ordinary  Least  Signifi- 

Squares  cance  Simple 

Coefficient     F       ofF  Correlation 


2 

R  for  Policy 

Variables  (R^ 
with  Covariables) 


.013 

32.95 

.000 

.54 

.30 

.031 

1.96 

.17 

.16 

(.31) 

.608 

7.90 

.006 

-.28 

.12 

.050 

.05 

.16 

(.14) 

.014 

31.70 

.000 

.54 

.31 

.030 

1.69 

.20 

.16 

(.32) 

.002 

.48 

.50 

-.05 
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Policy  Variables 

I    Observed  group  size 
Child-related  education 
training 

[I    Observed  staff/child  ratio 
Child-related  edxatior^/ 
training 

[II  Observed  group  size 
Child-related  education 

training 
Experience  in  current  day 

care  center 


Table  5.19 

Results  of  Re()ressions  of 
Caregiver  Behavior  Variables,  Spring  1977 
(Lead  Teachers,  n=87) 

CENTER-REIATED  ACTIVITY 


Ordinary  Least  Signifi- 

Squares  cance  simple 

Coefficient    2.     ofF  Correlation 


-.003 

1.28 

.26 

-.13 

-.001 

.001 

.91 

-.03 

.832 

15.68 

.000 

.41 

-0.12 

.24 

.65 

-.03 

-.003 

1.00 

.32 

-.13 

-.004 

.02 

.89 

-.03 

.001 

.01 

.91 

.02 

I 


Table  5.20 


Policy  Variables 

I  Observed  group  size 
Child-related  education/ 

training 

II  Observed  staff/child  ratio 
Child-related  educatiorv' 

training 

III  Observed  group  size 
Child-related  education/ 

training 
Experience  in  current  day 
care  center 


Results  of  Regressions  of 
Caregiver  Behavior  Variables,  Spring  1977 
(I^ad  Teachers,  n=87) 

ATTOION  TO  STAFF 


Ordinary  Least 

Squared 
Coefficient  F 


-.001 
-.002 


.427 
-.008 


-.001 
-.003 

.001 


.21 
.01 


14.69 
.44 


.17 
.05 

.32 


Sianifi- 

cance 

Simple 

of  F 

Correlation 

.65 

-.04 

.90 

-.07 

.000 

.38 

.51 

-.07 

.68 

-.04 

.82- 

-.07 

.57 

.38 

R  for  Policy 

Variables  (R^ 
with  Covariables) 

.00 
(.08) 


.15 
(.21) 


.01 

(.09) 
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Table  5.21 


Policy  Variables 

I    Observed  group  size 
Child-related  educatior^/ 
training 


II 


Observed  staff/child  ratio 
Child-related  education/ 
training 


III  Observed  group  size 
Child-related  educatior^/ 

training 
Experience  in  current  day 
care  center 


Results  of  Regressions  of 
Caregiver  Behavior  Variables,  Spring  1977 
(Lead  Teachers,  n=87) 

ADULT-RELATED  ACTIVITY 


uiainaiy  Lease 

Signifi- 

Squares 

cance 

LuciLxcienL 

F 

of  F 

1.74 

.19 

-.018 

2.43 

.12 

.022 

.03 

.87 

-.029 

3.61 

.06 

-.002 

2.04 

.16 

-.027 

1.96 

.11 

.000 

.40 

.55 

Simple 
Correlation 

-.15 
-.17 


-.02 
-.19 


-.15 
-.17 

-.03 


2 

R  for  Policy 

Variables  (R^ 
with  Covariables) 

.05 

(.12) 


.04 

(.10) 


.06 

(.13) 
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related  to  the  amount  of  time  teachers  spent  not  involved 
with  children.     A  higher  ratio  of  staff  to  children  (which 
usually  implied  more  staff)  meant  teachers  spent  signifi- 
cantly more  time  in  tasks  which  did  not  directly  involve 
children — e.g.,   in  preparation  activities — and  more  time 
with  other  staff.     This  finding  suggests  that  higher 
ratios  give  teachers  more  opportunity  for  "time-out"  during 
the  day  (but  do  not  necessarily  produce  less  total  inter- 
action between  a  child  and  a  teacher) . 

Discussion  of  Group  Size  and  Ratio  Effects 

Group  size  and  ratio  were  related  to  many  of  the 
same  teacher  behaviors  in  a  pattern  suggesting  that  larger 
classrooms  and  low  ratios  were  disadvantageous.  Larger 
groups  sizes  and  lower  staff-child  ratios  were  associated 
with  more  management  behavior,   especially  commanding,  and 
more  observing;  also  teachers  in  larger  classrooms  and  those 
with  lower  ratios  spent  more  time  with  groups  of  13  or  more 
children  and  less  time  with  smaller  groups.     it  is  to  be 
expected  thut  the  two  classroom  parameters  were  related  to 
similar  dependent  measures,   since  group  size  and  ratio  were 
confounded.     In  this  sense,   it  cannot  be  determined  whether 
the  findings  represent  a  group  size  effect,   a  ratio  effect 
or  both. 

The  particularly  strong  relationships  between  the 
group  composition  measures  and  the  TO  WHOM  codes  may  reflect 
teacher  style  or  the  characteristics  of  the  instrument. 
That  is,   the  way  in  which  the  FMI ' s  were  coded  meant  that  by 
definition  a  teacher  who  spent  more  time  with  large  groups 
of  children  had  to  spend  less  time  with  smaller  groups.  At 
the  sane  time,  the  pattern  of  effects  may  be  caused  by 
teachers  in  large  classrooms  and  in  low-ratio  classrooms 
choosing  to  work  with  larger  groups.     Whatever  the  reason. 


lo- 
ve 


however,  it  appears  that  the  actual  "head  count"  group  size 
is  an  important  factor  in  teacher  behavior. 

Caregiver  Qualification  Measures;  Child-Related 
Training  and  Experience  in  Current  Center 

Social  Inceraction.     Whether  teachers  had  child- 
related  education/training  was  significantly  related  to  the 
amount  of  social  interaction  with  children.     Teachers  with 
specialized  preparation  tended  to  do  more  social  interact- 
ing, especially  the  "warm"  behaviors  (PRAISE,  COMFORT, 
RESPOND).     Experience  in  current  center  was  not  significantly 
related  to  social  interaction. 

Management.     Neither  child-related  education/train- 
ing nor  experience  in  current  center  was  related  to  the 
amount  of  management,  nor  to  either  of  the  individual  com- 
ponent codes  of  COMMAND  or  CORRECT. 

Observes.     Neither  measure  of  caregiver  qualifica- 
tions was  associated  with  the  amount  of  observing  a  teacher 
did. 

Non-Child  Activities;     Center-Related  and  Adult- 
Related  Activitieo  and  Attention  to  Adults.     There  was  a 
tendency  for  caregivers  with  child-related  education/ 
training  to  spend  less  time  in  activities  that  were  non- 
child,  non-center  related.     A  teacher's  experience  in  the 
current  center  was  not  related  to  the  amount  of  non-child 
activities. 


Attention  to  One  child.  Small,  Medium  or  Large 
Grou£s.     How  a  teacher  distributed  her  time  was  not  related 
to  her  child-related  education/training.     A  teacher's 
experience  in  the  current  center  was  related  to  how  she 
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distributed  her  attention.     Longer  tenure  was  associated 
with  significantly  less  attention  to  medium  groups,  and  a 
tendency  for  more  attention  to  small  groups. 


Discussion  of  Caregiver  Qualifications 


Initially,   four  caregiver  qualifications  were 


tested  in  the  regressions.     Findings  for  two  of  these  were 
discussed  above — specialized  training  and  experience  in  the 
current  center.     The  other  two — years  of  education  and  pre- 
vious day  care  experience — ^had  no  effects  in  the  regressions 
for  lead  teachers,  but  are  discussed  briefly  below. 

SPECIALIZATION  was  associated  with  more  social 
interaction  of  all  types  with  children  and  less  time  in 
activities  that  did  not  involve  children.     The  apparently 
positive  effects  for  specialized  training  suggests  that 
training  actually  promotes  beneficial  behavior  by  the  lead 
teacher.     On  the  other  hand,  the  effects  might  also  be 
caused  by  lead  teachers  with  specialized  training  having 
different  classroom  responsibilities  than  those  without. 


the  regressions,   at  the  level  of  simple  correlations  its 
effects  were  similar  to  those  for  specialization.  That 
is,  caregivers  with  more  education  tended  to  do  more  social 
interacting  with  children.     The  problem  in  assessing  effects 
for  EDUCATION  was  its  confounding  with  the  covariablec 
(CAREGIVER  RACE  and  CLASSROOM  SES) .     The  confounding  meant, 
first,   that  when  YEARS  OF  EDUCATION  was  entered  in  the 
regressions  along  with  the  covariables,   EDUCATION  was  never 
significantly  related  to  lead  teacher  behavior.     Second,  it 
meant  that  the  simple  correlations  for  EDUCATION  could  not 
be  interpreted  as  simply  an  education  effect  but  as  an 
effect  of  a  complex  of  variables  including  education,  race 
and  SES. 


Although  YEARS  OF  EDUCATION  has  no  effects  in 
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Neither  of  the  measures  of  caregiver  experience 
was  strongly  related  to  caregiver  behavior.  EXPERIENCE 
IN  THE  CURRENT  CENTER  was  associated  with  how  the  lead 
teacher's  time  was  distributed.     Teachers  with  longer 
experience  tended  to  spend  more  time  with  small  groups  and 
less  time  with  medium  groups.     (one  caution  is  that  exper- 
ience was  confounded  with  ratio,   r=.41.     Therefore,  the 
effects  might  also  be  ratio  effects,  and  they  are  consistent 
with  the  findings  for  ratio.)     PREVIOUS  DAY  CARE  EXPERIENCE 
had  no  effects  in  the  regressions.* 


Covariables 

The  covariables  (race  of  caregiver  and  socio- 
economic status  of  the  children)  had  as  strong  an  effect  on 
lead  teacher  behavior  as  any  of  the  policy  variables.  Both 
covariables  were  entered  in  each  of  the  regression  models, 
and  they  added  significantly  to  the  prediction  of  caregiver 
behavior.     since  the  two  were  highly  correlated  (r=.56), 
usually  only  one  was  significant  for  any  dependent  measure, 
and  most  often  it  was  race  of  caregiver,     white  teachers, 
who  also  tended  to  be  in  classrooms  with  higher  average  SES, 
did  significantly  more  social  interacting,   including  more 
responding  and  praising  (Table  5.22).     They  also  did  signifi- 
cantly less  observing,  and  there  was  a  tendency  for  less 
adult-related  activity.     in  addition,   they  spent  significantly 
more  time  with  individual  children,  less  time  with  medium- 
sized  groups,  and  more  time  with  other  staff.     In  sum,  the 
classrooms  with  white  lead  teachers  and  the  higher-SES  class- 
rooms showed  more  teacher/ child  interaction,  particularly 
social  interaction  (but  with  a  trend  toward  more  management 
as  well)   and  less  observing. 


Sev^Sus          ^.rf'^'^"^^'^  ""9^  l^^d  teachers- 

intoThin^L        ■^^?^''""''^'  variable  was  transformed 

lence,  regardless  of  amount.  Comparison  of  teachers  with 
Comnared  T  "P^"^""  "°  significant  differences. 

^°          continuous  variable,  the  transformed  binary 
version  of  PREVIOUS  DAY  CARE  EXPERIENCE  did  not  have  any 
f^on^^""  relationships  to  caregiver  behavior  (or  any  rela- 
tionships,  for  that  matter).  ^ 
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It  is  important  to  note  again  that  since  the  co- 
variables  were  essentially  uncorrelated  with  the  policy 
variables,  they  did  not  alter  the  relationship  of  the  pol- 
icy variables  to  the  dependent  measures.     That  is,  although 
there  were  many  significant  relations  between  the  covari- 
ables  and  caregiver  behavior,  there  was  virtually  no  inter- 
action of  the  covariables  and  policy  variables.     In  the 
tables  of  regression  results,  only  the  coefficients  for  the 
policy  variables  are  given,  but  the  r2  accounted  for  by 
the  covariables  is  indicated  for  each  of  the  dependent  mea- 
sures. It  is  clear  that  the  covariables  frequently  were 
responsible  for  most  of  the  variance  explained. 

Regression  Results;     Aides  in  the  49-Center  Srudy 

Group  Composition  Measures 

The  group  composition  measures  had  moderate 
effects  for  aides.     For  MANAGEMENT,   larger  groups  were 
significantly  related  to  more  managing,  particularly  with 
the  component  code  COMMAND  (Tables  5.23-5.25).  Lower 
staff/child  ratios  were  also  related  to  more  COMMAND. 
There  were  no  significant  relationships  for  group  size  or 
ratio  with  social  interaction  or  its  component  codes  (Tables 
5.26-5.31).     In  addition,  there  were  no  relationships 
between  GROUP/siZE  or  RATIO  and  the  measures  of  non-child 
activities— OBSERVE,   CENTER  ACTIVITY,   ADULT  ACTIVITY,  or 
ATTENTION  TO  STAFF  (Tables  5.32-5.35). 

There  were,  however,  significant  effects  for  the 
TO  WHOM  codes   (Tables  5.36-5.39).     Larger  group  sizes  and 
lower  staff/child  ratios  were  related  to  more  time  with 
large  groups  and  less  time  with  small  groups. 
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Table  5.23  . 

Results  of  Four  Regressions  of 
Caregiver  Behavior  Variables 
(Aides,  n=42) 


Ordinary  Uast  R^forltolicy 
Squares  Significoice      Simple         ,  v&riables 

VMl^  Coefficient     J_   ■  ofF        Correlation      (R^  with  Covariables) 

I  Observed  group  size 
Child-related  education/ 

training 

« 

II  Observed  staff/child  ratio 
Child-related  education 

training 

III  Observed  group  size 
Child-related  education 

training 
Experience  in  current  day 
care  center 

IV  Observed  group  size 
Years  of  education 


,005 

5.29 

.03 

.35 

.13 

.007 

.12 

.73 

-.04 

(.13) 

-.357 

2.95 

.09 

-.28 

.08 

.002 

.01 

.92 

-.04 

(.08) 

.005 

5.11 

.03 

.35 

.14 

.006 

.06 

.81 

-.04 

(.14) 

.001 

.27 

.61 

.06 

.005 

4.96 

.03 

.35 

.20 

-.011 

3.21 

.08 

-.29 

(.20) 

10;] 


Table  5.24 


Results  of  Four  Regressions  of 
Caregiver  BiMor  Var[a^^ 
(Aides,  n=42) 

COMMAND 


n., .  Ordinary  Least  2 

Policy  R^forMicy 

^  CoefSnt      P     ^"1?"      '^"P^^         ;  V^^i^bles 


I    Observed  group  size 

M:related  eauratio^         M  7 
training  ■•12  (.35) 

ri  Observed  staff/child  ratio 

M-related  ed^atioV  '['^       t  "iJ  '14 

training  "-IS  (.18) 


.004 
.002 

16.68 
.04 

.000 

•  vvv 

.85 

-.12 

-.252 
-.003 

5.77 
.09 

.02 
.77 

-.40 
-.12 

.004 
-.0001 

15.78 
.00 

.000 
.99 

.58 
-.12 

.0001 

.02 

.90 

-.01 

.004 
-.004 

17.22 
1.85 

.000 
.18 

.58 
-.24 

(R  with  Covariablesl 


III  Observed  group  size 

M-related  «3.atioV        -iJooi  '58  .32 

training  -'12  (.36) 

Experience  in  current  day 
care  center 

IV  '  Observed  group  size 

Years  of  ed^ation  Jm  .34 

(.38) 


1.10 

o 
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Table  5.25 

Results  of  Four  Regressions  of 
Caregiver  Behavior  Variables 
(Aides,  n=42) 

CORRECT 


Policy 

Ordinary  Least 

Squares 

jignificance 

Simple 

Variables 

Coefficient 

JL. 

of  F 

Correlation 

I   Observed  group  size 

.001 

.37 

.55 

.07 

uiuQ-reiatea  eaucatioiv 

.005 

.15 

.70 

.04 

training 

II  Observed  staff/child  ratio 

-.105 

.62 

.44 

-.11 

Child-related  educatior^/ 

.005 

.15 

.70 

.04 

training 

III  Observed  group  size 

.001 

.42 

.52 

.07 

Child-related  edxatiorj/ 

.006 

.15 

.70 

.04 

training 

Experience  in  current  day 

.001 

.48 

.11 

care  center 

IV  Observed  group  size 

.001 

.16 

.68 

.07 

Years  of  education 

-.007 

3.00 

.09 

-.26 

R^  for  Policy 
2  Variables 
(R  with  Covariables) 

.01 

(.02) 


.01 

(.02) 


.02 

(.03) 


(.09) 
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Table  5.26 


Results  of  Pour  Regressions  of 
Caregiver  Behavior  Variables 
(Aides,  11=42) 

SOCIAL  fCTICH 
Ordinary  I^ast     ,     •  ^2 

vSL  coeSnt      F     'IfT  ,2  '''''' 
  J_  ...  ofF_     Correlation      [t with Covariables) 

I  Observed  group  size 

Oiild-related  aj^atioo/        -.050        2:28      M  ^  .t 

training  ^'^^z 

II  Observed  staff/child  ratio  •      .052         .03      .88  -no 
Child-related  education/        -.050        2  35  '       '-^n  ,  i 


training 


.000 

.00 

.99 

-.00 

-.050 

Ml 
•14 

-.20 

.052 

.03 

.88 

".UU 

-.050 

2.35 

.13 

-.20 

.001 

.03 

.87 

.00 

-.060 

3,96 

.06 

-.20 

.005 

1.70 

.20 

.06 

.001 

.12 

.74 

-.00 

-.005 

.18 

.68 

-.02 
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11^ 


(.12) 


III  Observed  group  size  g, 

aild-:elated  d^atio^        -.060        3,'96      .'06  ('  ) 

training  "  ^'^^^ 

m         Experience  in  current  day 
care  center 

IV  group  size   

Years  of  education  ..nn^         m       «  \. 


Table  5.27 

Results  of  Four  Regressions  of 
laregiver  Behavior  VariaEIeT 
(Aides,  n=42) 

mm  

Ordinary  Ifiast  R^forMicy 

Squares             Significance  Simple         ,  variables 

HiES5                   Coefficient     j_      ofF  Correlation      (R^  with  Covariables) 

I  Observed  group  size 
*   Child-related  education/ 

training 

II  Observed  staff/child  ratio 
Child-related  education/ 

training 

III  Observed  group  size 
Child-related  educatiop/ 

0)  training 
^        Experience  in  current  day 
care  center 

IV  Observed  group  size 
Years  of  education 
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-.001 

.25 

.62 

-.05 

.03 

-.014 

1.03 

.32 

-.14 

(.03) 

-.014 

.01 

.92 

-.04 

.02 

-.011 

.70 

.41 

-.14 

(.02) 

-.0002 

.17 

.91 

-.05 

.15 

-.024 

2.96 

.16 

-.14 

(.15) 

.008 

.93 

.03 

.23 

-.0004 

.07 

.79 

-.05 

.01 

-.001 

.07 

.79 

-.03 

(.01) 
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Table  5.28 

Results  of  Four  Rqressions  of 
Caregiver  Behavior  Variables" 
(Aides,  n=42) 

RESPOND 


Ordinary  Least 

  jy^^^^^l^L.   .JL  .__.ofF  Correlation 

I  Observed  group  size  .0003         51  ci 
Oiild-related  ed^atio^         .003         [  g  5 

training  . 

II  Observed  staff/child  ratio  .064        ug  10 
Oiild-relatd  ejucatiot^  .OOl         'n  ' 

training  ^  ^ 

III  Observed  group  size 
Child-related  education 

training 
Experience  in  current  day 
care  center 

IV  Observed  group  size 
te  of  education 


.0004 

.45 

.51 

-.03 

.002 

.16 

.68 

,11 

.0001 

.06 

80 

-.06 

.0003 

.31 

.58 

-.03 

.0005 

.11 

.75 

.12 
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Table  5.29 

Results  of  Four  Regressions  of 
Caregiver  Behavior  Variables 
(Aides,  n=:42) 

 INSTRUCT 

Ordinary  Least  ^2 

|R  with  Covariables) 

I   Observed  group  size  -.0004        .05      .82  -  01  no 

Child-reM  education/        -.035        3.75  .Ofi 


training 


II         staff/child  ratio  ..q^. 
Child-related  educatioi)/        -.034        3.51  07 


training 


Squares 
Coefficient 

F 

Significance 
OfF 

Simple 
Correlation 

-.0004 

.05 

".Ui 

-.035 

3.75 

.06 

-.26 

-.025 

.02 

.89 

-.07 

-.034 

3.51 

.07 

-.26 

-.0004 

.05 

.83 

-.01 

-.041 

4.38 

.04 

-.26 

.002 

.54 

.47 

.01 

.0004 

.04 

.84 

-.01 

-.004 

.36 

.55 

-.05 

(.13) 


(.13) 


III  Observed  group  size  -01  11 

Child-related  a3ucatioV       -.041        4.38      .04  06 
training 

aperience  in  current  day 
care  center 

IV  to^  group  size   

Years  of  education  -.004  „.t 

(.Ul)) 
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Table  5.30 


00 
0 


ERIC 


1'^ 


wregiver  Behavior  Variables 
(Aides,  n=42)  ~ 

COMPORT 

Policy 
Variables 

Ordinary  Least 

Squares 
Coefficient 

Significance 
F        of  F 

Simple 
Correlation 

R  for  ft)licy 
2  Variables 
(R  with  Covariables) 

.00 

(.01) 

I    Observed  group  size 
Child-related  educatior)/ 
training 

-.0001 
.001 

.02 
.03 

.88 
.87 

-.04 
.03 

11  Observed  staff/child  ratio 
Child-related  education 
training 

.029 
.0004 

•44 
.11 

.50 
.92 

.13 
.03 

.02 

(.03) 

III  Observed  group  size 
Child-related  ediraUnn/ 

training 
Experience  in  current  day 
care  center 

.000 
-.002 

.002 

.00 
.23 

11.09 

.98 
.63 

.002 

-.04 
.13 

.45 

.25 
(.26) 

IV  Observed  group  size 
Years  of  education 

-.001 
-.0004 

.04 
.08 

.83 
.78 

-.04 
-.04 

.01 
(.01) 

Table  5.31 


Policy 
Variables 

I  Observed  group  size 
Child-related  educatioiV 

training 

II  Observed  staff/child  ratio 
Child-related  education/ 

training 

III  Observed  group  size 
Child-related  educatior)/ 

training 
Experience  in  current  day 
care  center 

IV  Observed  group  size 
Vears  of  education 


Results  of  Four  Regressionsjf 
"Caregiver  Behavior  Variables" 
(Aides,  n=42) 


PRAISE 


Ordinary  Least 

Squares 
Coefficient 

•Significance 
of  P 

Simple 
Correlation 

.001 

.80 

.38 

.11 

-.005 

.30 

.59 

-.10 

-.001 

.0001 

.99 

-.00 

-.007 

.57 

.46 

-.10 

.001 

1.74 

.20 

.11 

-.005 

.38 

.54 

-.10 

.0003 

.10 

.75 

-.06 

R  for  Policy 
2  Variables 
(R  with  Covariables) 

.04 
(.08) 


.02 
(.06) 


.06 

(.10) 


.001 
.0001 


1.12 
.001 


.30 
.97 


.11 
.03 


.03 
(.07) 
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Table  5.32 


H 


Policy 
Variables 

I  Observed  group  size 
Child-related  educatioo/ 

training 

II  Observed  staff/child  ratio 
Child-related  educatioo/ 

training 

III  Observed  group  size 
Child-related  education/ 

training 
Experience  in  current  day 
care  center 

IV  Observed  group  size 
Years  of  education 


Results  of  Four  Regressions  of 
Caregiver  Behavior  Variables" 
(Aides,  n=42) 

  OBSERVE 


Ordinary  Least 

Sjuares 
Coefficient 


Significance  simple 
1 ._        of  F  Correbti 


-.005 
.038 

1.60 
1.03 

.21 
.32 

-.19 

.18 

.505 
.040 

1.80 
1.15 

.19 
.29 

.24 
.18 

-.006 
.053 

1.91 
1.79 

.18 
.19 

-.19 
.18 

-.008 

3.52 

.07 

-.18 

-.006 
-.007 

2.55 
.30 

.12 
.58 

-.19 
-.10 

,2 


2 

R  for  Policy 
Variables 
(R"  with  Covariables) 


(.11) 


.09 
(.12) 


.15 
(.18) 


.07 
(.10) 


I 


10 


Table  5.33 

Results  of  Four  Regressions  of 
Caregiver  Behavior  VariableT 
(Aides,  n=42) 

CENTER-REIATED  ACTIVITy 

vSs  rT^.       .  5  ^^i^bles 

HiE!!  Mhcmt     J_      ofF        Correlation      (R^ith  Covariables) 

I    Observed  group  size  .001         .03       .87  oi  ni 

Child-related  education/  .001  .001       Q?  'ni  /a. 


training 


II  Observed  staff/child  ratio  .a       ./^  .qs  01 

Child-related  education/         .002         .003      ^96  'm 


training 


training 
Qcperience  in  current  day 
care  center 

IV  Observed  group  size 
Years  of  education 


Squares 
Coefficient 

F 

Significance 
OfF 

Simple 
Correlation 

.001 

.03 

.87 

.01 

.001 

(101 

•7/ 

iOl 

-.115 

.11 

.74 

-.05 

.002 

.003 

.96 

.01 

.000 

.02 

.90 

.01 

.000 

.00 

.99 

.01 

.004 

.82 

.37 

.14 

.001 

.09 

.76 

.01 

.019 

3.16 

.08 

.28 

e4  11 


(.01) 


(.01) 


III  Observed  group  size 

Child-related  educatiorv'         .000         .00       99  ni  .  im 


(.03) 


(.08) 


Table  5.34 


Results  of  Four  Regressions  of 
L;aregiver  BehavlorVarlaEIer 
(Aides,  n=42) 


Policy 
Variables 

Ordinary  Least 

Squares 
Coefficient 

r 

Significance 
or  F 

Simple 
Correlation 

R  for  Policy 
2  Variables 
(R  with  Covariablesl 

.02 

(.10) 

I    Observed  group  size 
Child-related  education 
training 

-.001 
.004 

.26 
.08 

.61 
.78 

-.01 
.04 

II  Observed  staff/child  ratio 
Child-related  education/ 
training 

-.093 
.007 

.28 

.49 
.60 

-.12 
.04 

.01 

(.09) 

III  Qbs&n/^vl  nrnim  ei7a' 

Child-related  educatiori/ 
training 

2      Experience  in  current  day 
care  center 

-.001 

.003 

-.002 

.43 

.05 

.04 

.59 
.79 

.82 

-.01 
.04 

-.07 

.02 
(.10) 

IV  Observed  group  size 
Years  of  education 

-.001 

.004 

.25 
.81 

.63 
.37 

-.01 
.08 

.01 

(.09) 
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Table  5.35 

Results  of  Four  Regressions  of 
"Cireglver  Behavior  Variables" 
(Aides,  ns42) 

ATTENTION  TO  STAFF 

Of^i"3ry  Least  D2f«.  iv,iu, 

(R  with  Covariables: 

I  Observed  group  size 

ttild^telated  aiucatioV        -.025        U?       !  .;  /?' 

training  l'^^^ 

II  Observed  staff/child  ratio 

aild-related  eJucation/         -.028        2.35       J  J  n  ^ 

training  '^^  (-17) 


\^  training 

\  Experience  in  current  day 
\^-oare  center 


Squares 
Coefficient 

P 

Significance 

Simple 
Correlation 

.001 
-.025 

.37 
1.87 

.55 

18 

flu 

.06 

-  on 

-.008 
-.028 

.002 
2.35 

.97 

.13 

.02 
-.20 

.001 
-.020 

.53 
1.06 

.47 
.31 

.06 
-.20 

-.001 

.10 

.76 

-.19 

.002 
-.010 

.74 

J.06 

.40 
.09 

.06 
-.20 

r 

fill  Observed  group  size 

Child-related  education/        -.020        1.06       .n  .  o 


(.17) 


IV  Observed  group  size 

Years  of  education  -.oin         V.flfi  no 

(.21) 
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Table  5.36 


Policy 
Variables 

I    Observed  group  size 
Child-related  education 
training 

n  Observed  staff/child  ratio 
Child-related  educatioo/ 
training 

in  Observed  group  size 
Child-related  educatiorv' 

training 
Experience  in  current  day 

care  center 

IV  Observed  group  size 
Vears  of  edication 


Results  of  Four  Regressions  nf 
Caregiver  Behavior  Variah]p.r 
(Aides,  n=42) 

._  .ATrENTIOM  TO  ONE  CHILD 
Ordinary  Least 

^  Squares  Significance 
Coefficient       f        nf  p 


.001 

.89 

-.027 

.57 

.45 

.247 

.48 

.50 

-.032 

.84 

.37 

.001 

.07 

.80 

-.047 

1.50 

.23 

.004 

.95 

.34 

.001 

.06 

.81 

-.014 

1.53 

.22 

ERIC 


Table  5.37 


Results  of  Four  Re(|resslons  of 
Caregiver  Behavior  Variables 
(Aides,  n=42) 

ATTENTION  TO  SMftLL  GRQUK 

Ordinary  Least  o2 


Policy  Squares  Significance  simple 

Variables  Coefficient       F         ofF         Correlation  (R^ 


I  Observed  group  size 
Child-related  educatioiV 

training 

II  Observed  staff/child  ratio 
Child-related  educatiori/ 

training 

III  Observed  group  size 
Child-related  education/ 

training 
Experience  in  current  day 
care  center 

IV  Observed  group  size 
Years  of  education 


ERIC 


R  for  Policy 
Variables 


Correlation      (R'  with  Covariables) 


-.009 

8.18 

.007 

-.43 

.21 

.020 

.50 

.48 

.18 

(.24) 

.997 

14.64 

.000 

.56 

.31 

.020 

.62 

.44 

.18 

(.34) 

-.008 

8.92 

.005 

-.43 

.21 

.007 

.06 

.81 

.18 

(.25) 

-.002 

.31 

.58 

-.06 

-.009 

9.74 

.003 

-.43 

.20 

-.001 

.02 

.90 

.00 

(.23) 

Table  5.38 

Results  of  Four  Regressions  of 
Caregiver  Behavior  VariaEIeT 
(Aides,  n=42) 

AMIOM  TO  MEDIUM  GROUPS 

Ordinary  tost  B^forMicy 

(R  with  Covarlables) 

I  Observed  group  size  ,^ 

Oiild-related  edicatio^         -.036         l.'gs       [n  l,^  ft 

training 

II  Observed  staff/child  ratio        ....  .„ 

Oiild-related  aJicatioV         -.034         1.78       [19  -j  ( n , 

training 


Squares 
Coefficient 

F 

Significance 
of  F 

Simple 
Correlation 

-.002 
-.036 

.72 
1.95 

.40 
.17 

-.10 
-.19 

.182 
-.034 

.49 

1 78 

.49 

1Q 

.08 

in 

-.19 

-.002 
-.023 

.65 
.72 

.42 
.40 

-.10 
-.19 

-.001 

.11 

.75 

-.09 

-.002 
-.012 

.39 
2.01 

.54 
.17 

-.10 
-.20 

III  Observed  group  size 

Oiild-related  edicatioV         -.023  .72       .40  -j  , 

training 

Experience  in  current  day 
care  center 

IV  Observai  group  size 
Years  of  education  -.015  n 

(.0/) 


ERIC  1 


Table  5.39 

Results  of  Four  Regressions  of 
"Caregiver  Behavior  Variables' 
(Aides,  n=42) 

AmrricN  ro  large  groups 

variapies  Coefficient       p         nfp  /n2 


Ordinary  Least 

Squares 
Coefficient 

F 

Significance 
of  F 

Simple 
Correlation 

.010 

5.94 

.02 

.35 

.056 

2.08 

.16 

.11 

-1.171 

10.11 

.003 

-.44 

.055 

2.25 

.14 

.11 

.010 

5.12 

.03 

.35 

.072 

3.12 

.09 

.11 

-.005 

1.14 

.29 

-.09 

.009 

4.82 

.03 

.35 

.013 

1.13 

.29 

.10  . 

(R  with  Covariables) 


I  Observed  group  size 

Child-related  education/  .056         2.08       .16  11  im 

training  ' 

II  Observed  staff/child  ratio 
Child-related  educatior;/ 

training 

III  Observed  group  size 
Child-related  educatioiV 

training 
B(perience  in  current  day 
care  center 

IV  Observed  group  size  ^35 
Years  of  education  .013         i.n        m  m  ^[{gj 


.22 
(.25) 


.18 
(.22) 
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Caregiver  Qualifications 


Three  of  the  four  qualifications  variables  were 
associated  with  aide  behavior.     YEARS  OF  EDUCATION,  SPECIAL- 
IZATION,  and  EXPERIENCE  IN  CURRENT  CENTER  each  had  a  few 
effects,  while  PREVIOUS  DAY  CARE  EXPERIENCE  had  none. 

SOCIAL  INTERACTION  and  its  component  codes  had  a 
few  relationships  to  aides'   qualifications.     There  was  a 
trend  for  aides  with  specialized  training  to  do  less 
social  interacting  and  less  instructing.     YEARS  OF  EDUCA- 
TION was  not  associated  with  amount  of  social  interacting . 
Aides  with  more  experience  in  the  center,  however,  did 
significantly  more  praising  and  comforting. 

MANAGEMENT  and  its  component  codes  was  not 
significantly  related  to  any  qualifications.     There  was  a 
trend  for  aides  with  more  education  to  do  less  correcting 
and  less  managing. 

The  effects  for  the  non-child  activities  were 
small.     There  Was  a  trend  for  less  observing  by  aides  with 
more  center  experience.     The  amount  of  time  in  center 
activity  or  staff  activities  was  weakly  related  to  aides' 
qualifications.     There  were  trends  for  less  center  activity 
among  aides  with  specialization  and  more  activity  among 
aides  with  more  education.     The  amount  of  non-child,  non- 
center  activity  was  not  related  to  aide  qualifications. 
There  were  no  significant  relationships  between  aide  quali- 
fications and  the  TO  WHOM  codes. 


Covariables 


The  effects  of  the  covariables  for  aides  were 
small,  much  smaller  than  the  effects  for  teachers  (Table 
5.40).     The  classroom  SES  was  never  a  significant  predictor 


Table  S.40 


Siiipl»  Cotrtlitloni  of 
Spring  tfl  maim  and  Covtrlibleg.  Mdei 


O 


S<wW  lb     ft  Tb 

Inter-    m^t-    ob-    centar-  Mult-    Ot*   aull    Mm  l^rgi    ft     Cw      Cor-     Oues-    in-  Ol-  ite- 

action    _Mnt_    jw^MaUdRalatedg^  Staff    unl      teet     tlon    struct    Pral«  fort 


OASSSEs' 


.05      .13     .10     -.15      .  27    -.19       .07       .02      .04       .13      .10  .30" 
RigresBlon  co«f  f  ident       ns^       «       m      n»       n»      m      n«     «  „ 

«l  Slgnlflcaite^  rawmnansnanansm       ns  nansnsnsns 


^        CMKIVER  RACE^ 


tottdatlon  .25      -M      -.17      .07     -.29      .  22     -.03     .09     -.17      .  32'  -.15       .06       .05  .20 


Rqrnslon  Cotfflclcnt      .06        ns  -.06 


ns     -.02      nt      ns     ns      ni     .04     nt       ni       na  .03 


(and  Sl9nlflcanc«|         (.11)  (.m)  (.ij) 


.20      .04  .41" 

ns      ns  .01 


1.08)  (.12)  (.05) 


CUSS  SES  was  a  factor  scort  across  five  neasures  of  aocloecononlc  status  of  the  children  In  each  claauoaa. 

Ilace  was  coded  as  'l*  for  black  caregivers  and  '2'  for  tlilte  caregivers, 

Wflcients  Indicated  only  If  p(.25. 
*  p<.05. 
"  p<.01. 
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for  aide  behavior.     Race  of  caregiver  had  a  significant 
effect  only  for  RESPOND;  and,  as  was  true  for  teachers, 
white  aides  more  often  responded  to  children.     The  pattern 
of  other  nearly-significant  effects  was  consistent  with  that 
for  teachers,  with  more  social  interacting  and  less  observ- 
ing, and  more  time  in  staff  activities  for  white  aides. 

Discussion  of  Findings  for  the  49-Center  Study 

The  findings  of  the  regression  analyses  for  49- 
center  lead  teacher  and  aides  are  summarized  in  Table  5,41, 
For  the  group  composition  measures,  there  was  sufficient 
consistency  in  the  findings  across  the  two  samples  of  care- 
givers to  discuss  them  as  a  whole;  that  is,  there  was  little 
evidence  of  an  interaction  between  caregiver  role  in  the 
classroom  and  the  group  composition  measures.     For  teachers 
and  aides,  the  size  of  the  classroom  was  strongly  related 
to  the  size  of  activity  subgroups:     larger  classrooms  meant 
caregivers  dealt  more  often  with  large  groups  (13  or  more 
children).     Also,  the  size  of  the  classroom  was  related  to 
what  caregivers  did,  with  more  observing,  more  management 
interaction,  and  less  social  interaction.     Thus,   in  smaller 
classrooms,   it  seems  likely  that  a  child  received  more 
direct  interaction  with  the  caregiver. 

Regarding  the  size  of  activity  subgroups,  the 
effects  for  ratio  followed  a  similar  pattern  to  the  effects 
for  group  size.     Higher  ratios  were  associated  with  more 
time  with  small  groups.     On  the  other  hand,  ratio  affected 
v^iat  caregivers  did  in  a  different  pattern  than  group  size 
did.     Higher  ratios  were  associated  with  more  non-child- 
interaction  activities  as  well  as  less  observing  and  manag- 
ing.    Caregivers  in  high-ratio  classrooms  tended  to  spend 
more  time  in  center-related  activities  such  as  preparation 
and  in  interaction  with  other  staff. 


101 


I 


Tibti  Ul 


wt 


H 
0 

10 


KCtAl 

A^t    Mto.  to 

JkttR^tO 

Chill 

Ssgi 

Mm 

tatot 

Inrtruct 

G(oup  tiN 

(♦I  « 

• 

• 

1 

(♦1 

IU(t/Oiltdlitll 

♦ 

* 

H 

llWllilUttM 

H 

111 

H 

♦ 

Ul 

(4) 

hm\M  Diy  Cki  bpulmi 

OBIiia  (t*«[u) 

FliM  in 
\lm§  mm 

(•1  ♦ 

m 

(•I 

1 

* 

nm 

MCIM. 

pflHUCTitt  mga  oamn 

GmUt 

Mult    Mta.  t0 

Ml  Ctow 

ftffict  QwiUm 

{filii 

Igttjct 

1 

• 

W 

♦ 

■ 

i^lilliitlo* 

H 

w 

fwiif  Mattel 

l-l 

(•I 

w 

H 

(-1 


1*1 


ilu  fiotd  Mf  I  li^ltlent  K  r(«Ur  rnutu  ilf  nllleat  it  .n<p(.lS  Hm  !•  pititlMli. 


In  both  samples,   there  were  a  few  significant 
findings  that  suggested  positive  effects  for  more  caregiver 
qualifications.     However,   there  was  little  consistency 
across  the  teacher  and  aide  samples.     The  caregiver  variables, 
SPECIALIZATION  and  EXPERIENCE  in  current  center,  had  scattered 
effects  in  both  samples.     For  SPECIALIZATION,   teachers  with 
specialized  training  tended  to  do  more  social  interacting. 
SPECIALIZATION  had  few  effects  for  aides,  possibly  because 
so  few  aides  had  specialized  training.     Those  aides  with 
specialized  training  tended  to  spend  more  time  with  large 
groups  of  Children  and-  less  time  in  staff  activities,  which 
suggests  more  direct  responsibility  for  children.  However, 
they  also  tended  to  do  less  instructing.     EXPERIENCE  in 
current  center  was  associated  with  more  attention  to  small 
groups  and  less  commanding  for  teachers,  and  with  more 
"warm"  interactions  with  children  (QUESTIONS,   COMFORTS)  and 
less  observing  for  aides.     YEARS  OF  EDUCATION  had  some 
effects,   but  for  aides  only.     Aides  with  more  education 
tended  to  manage  less  frequently  and  to  spend  more  time  in 
non-Child  activities.     Since  caregivers  in  supervisory  roles 
(e.g.  center  directors)  also  tended  to  exhibit  these  behaviors, 
this  may  be  a  reflection  of  aides  with  more  education  being 
put  in  more  of  a  supervisory  role  for  the  classroom. 
Previous  day  care  exoerienn^  had  no  effects  in  either 
sample. 


In  the  following  sections,   three  additional  sets 
of  analyses  are  discussed:     tests  of  other  independent  mea- 
sures,  analyses  of  fall  AFI  data,   and  analyses  of  APS  data. 
These  analyses  suggest  general  consistency  in  the  findings 
for  all  of  the  independent  measures,   with  particularly  good 
stability  for  the  group  composition  variables. 
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Regression  Results;     Fall  AFI  Analyses  in  the  49-Center  Study 


Lead  Teachers 


In  the  parallel  regression  analyses  of  the  fall 
49-center  AFI  data,  virtually  none  of  the  effects  contra- 
dicted those  in  the  spring  data  (Table  5.42).     Where  the 
effects  of  a  predictor  were  significant  for  both  fall 
and  spring,  the  results  were  generally  similar  in  direction. 
Typically,  however,  a  significant  effect  in  one  data  set  was 
matched  by  a  nonsignificant  effect  in  the  other  data  set 
(although  the  simple  correlations  were  virtually  always  in 
the  same  direction).     Group  size,  ratio  and  the  covariables 
had  relatively  stable  effects  across  the  fall  and  spring 
data  sets.     The  caregiver  qualifications  variables  had 
scattered  effects  at  both  timepoints,  and  few  overlapping 
effects.     Also  the  regressions  for  the  TO  WHOM  codes  gen- 
erally were  more  similar  at  fall  and  spring  than  those  for 
the  WHAT  codes,  because  of  the  strong  and  consistent  effects 
for  the  group  composition  measures. 

Aides 

The  regressions  carried  out  on  the  aide  samples 
were  generally  less  consistent  across  timepoints,  compared 
with  those  for  teachers  (Table  5.43).     The  absence  of  strong 
effeccts  in  either  the  fall  or  spring  aide  samples  helped  to 
create  the  picture  of  inconsistent  results  at  fall  and 
spring.     The  relatively  small  s^tmple  sizes  probably  contrib- 
uted to  the  lack  of  consistent  results.     Besides  the  covari- 
ables, only  ratio  showed  any  consistent  effects  across  the 
timepoints,  and  the  covariables  were  much  stronger  predictors 
for  aides  in  the  fall.     As  was  true  for  lead  teachers,  the 
regression  results  for  the  TO  WHOM  codes  were  more  parallel 
at  fall  and  spring  than  the  results  for  the  WHAT  codes. 
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Neither  group  size  nor  the  caregiver  variables,  however,  had 
particularly  stable  effects. 


Discussion 

It  should  be  noted  that  there  are  multiple 
possible  explanations  for  inconsistencies  between  the  fall 
and  spring  results.     For  example,  different  data  collection 
procedures  might  be  responsible  for  the  differences.     In  the 
spring,  each  caregiver  was  observed  on  two  mornings,  by  two 
observers,  one  black  and  one  white,     in  the  fall,  each 
caregiver  was  observed  on  one  or  two  mornings,  by  one 
observer,  usually  of  the  same  race.    Thus,  the  fall  results 
are  more  likely  to  be  confounded  with  observer  differences, 
particularly  observer  race.     Pall-spring  differences  also  ' 
might  result  from  fallible  measures,  both  independent  and 
dependent.    A^third  possible  reason  for  differences  is  that 
Changes  may  have  occurred  in  the  day  care  classrooms  over 
the  year,     it  is  possible  that  variables  such  as  group  size 
operate  differently  in  classrooms  in  October,  when  classrooms 
were  still  getting  organized,  and  in  classrooms  in  April. 
If  so,  fall-spring  differences  might  reflect  actual 
differences  in  relationships  between  policy  variables  and 
specific  caregiver  behaviors  at  different  time,   in  the  day 
care  year,  although  the  same  policy  variables  seemed  to  have 
generally  positive  effects  at  both  time  points.    There  were 
some  notable  differences  in  the  fall  in  the  intercorrelations 
of  the  independent  measures,  particularly  for  aides.  Among 
aides,  there  was  more  confounding  among  the  independent 
measures  at  fal^  than  at  spring,  particularly  between  the 
experience  variables  and  the  classroom  parameters. 
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.Regression  Results:  Caregivers  in  the  Atlanta  Public 
School  (APS)  Centers* 
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A  major  substudy  of  the  NDCS  involved  eight 
centers  operated  by  the  Atlanta  Public  Schools.    The  APS 
centers  provided  a  strong  test  of  the  effects  of  the  policy 
variables,  first  because  of  the  homogeneity  of  the  child 
population  and  caregivers  in  the  centers  (all  were  black  and 
similar  in  socioeconomic  status)  and  second  because  the  APS 
experiment  involved  random  assignment  of  children  to  classes 
within  centers,     it  was  hypothesized  that  the  effects  of  the 
policy  variables  would  be  similar  in  direction  to  the 
19-center  effects  but  stronger  in  the  APS  sample. 


*For  more  detailed  discussion  of  the  APS  findings  and  the 
APS  experiment,  see  Goodrich^  N.  N.  (1980). 
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CHAPTER  ONE;     INTRODUCTION  TO  THE  NDCS 


The  National  Day  Care  Study  (NDCS)  was  a  four-year 
study  of  center-based  preschool  day  care,     it  was  initiated 
in  1974  by  the  Office  of  Child  Development  (now  Administra- 
tion for  children.  Youth  and  Families).     The  major  objective 
of  the  NDCS  was  to  determine  the  impact  of  variations  in 
staff/child  ratio,  number  of  caregivers,  group  size  and 
staff  qualification  on  both  the  development  of  preschool 
children  and  the  costs  of  center  care. 

The  National  Day  Care  Study  (NDCS)  was  undertaken 
to  provide  empirical  information  in  three  areas  of  major 
policy  concern:     (1)   the  quality  of  day  care  provided,  (2) 
the  per-child  cost  of  the  day  care  provided;  and  (3)  the 
potential  quality-cost  trade-offs  associated  with  alternative 
formulations  of  federal  day  care  regulations.     The  study 
focused  on  the  largest  group  of  children  receiving  federally 
subsidized  care— preschool  children  (aged  3-5) —and  on  the 
day  care  settings  in  which  most  of  these  children  are 
found—urban  day  care  centers  serving  low-income  families. 
The  study  also  focused  on  program  characteristics  that  have 
long  been  considered  key  determinants  of  quality  and  cost  in 
center  care— staff/child  ratio,  group  size  and  caregiver 
qualifications.     The  mandate  of  the  NDCS  was  to  examine  the 
impact  of  variations  in  these  and  other  regulatable  charac- 
teristics on  the  quality  and  cost  of  care  received  by 
preschool  children. 

The  NDCS  addressed  the  following  major  policy 

questions: 

•    How  is  the  daily  experience  and  consequent 
development  of  preschool  children  in  day  care 
centers  affected  by  variations  in  staff/child 
ratio,  group  size,  caregiver  qualifications  and 
other  regulatable  center  characteristics"? 
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•  How  is  the  per-child  cost  of  center-based  day 
care  affected  by  variations  in  staff/child 
ratio,  group  size,  caregiver  qualifications  and 
other  regulatable  center  characteristics? 

•  How  does  the  cost-effectiveness  of  center-based 
day  care  change  when  adjustments  are  made  in 
staff /child  ratio,  group  size,  caregiver 
qualifications  and  other  regulatable  center 
characteristics? 

This  document  reports  analytic  findings  relevant 
to  the  first  policy  question,  specifically,  how  is  preschool 
child  activity  and  behavior  in  day  care  centers  related  to 
variations  in  key  program  characteristics  (group  size, 
ratio,  and  caregiver  qualifications)?    The  activities  and 
behavior  of  children  in  the  day  care  setting  is  possibly  the 
most  crucial  category  of  measurement  in  studying  quality  of 
day  care  since  it  directly  reflects  the  experiences  that  are 
presumed  to  influence  the  social,  emotional  and  cognitive 
growth  of  children.     Relationships  between  the  key  NDCS 
program  characteristics  and  child  activity  in  the  centers, 
therefore,  might  suggest  regulatory  approaches  that  positively 
influence  the  quality  of  care  for  children. 

Selection  of  observation  techniques  as  opposed  to 
other  data  collection  methods,  such  as  rating  scales  (by 
teachers  or  observers)  and  standardized  tests,  is  related 
to  the  goals  and  independent  variables  in  the  NDCS.  The 
NDCS  goals  were  to  relate  various  classroom  parameters  to 
the  experience  of  children  in  the  day  care  environment  and 
to  assess  the  long  term  impact  of  those  experiences.    At  the 
outset  of  the  NDCS,  a  number  of  standard  tests  and  ratings 
were  proposed  to  measure  various  social  skills  of  children 
in  day  care.     For  various  reasons,  each  of  those  tests  were 
rejected,  primarily  on  psychmetric  grounds  (Stallings  and 
Broussard,  1977).     In  addition,  it  was  apparent  that  the 
links  between  the  associated  social  skills  and  the  day  care 
classroom  vriables  were  indirect  at  best,  and  in  many  cases 
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Were  justified  only  by  conjecture.     Direct  observation  of 
children  offered  the  best  possibility  of  linking  meaningful 
child  behaviors  in  the  day  care  center  directly  to  descripto 
of  the  center  itself,     such  procedures  have  strong  intuitive 
appeal.    The  connection  between  data  and  phenomena  is 
usually  direct.    Observations  provide  researchers  with  some 
of  the  indicators  of  quality  that  are  available  to  parents 
when  choosing  a  day  care  center  for  their  child,  i.e., 
impressions  of  the  degree  to  which  the  center  provides 
stimulating  social  interaction  among  children  and  between 
adults  and  children,  and  the  extent  to  which  it  elicits 
cooperative,  creative  and  verbal  intellectual  activity  on 
the  part  of  the  child.    Natural  observations  avoid  the 
artificiality  that  opens  many  laboratory  studies  to  the 
charge  that  their  findings  have  nothing  to  do  with  real- 
vorld  behavior.     Use  of  such  observations  in  the  NDCS 
exemplifies  the  -ecological"  approach  to  the  study  of  child 
development  urged  by  some  of  the  field's  most  prominent 
spokesmen,  notably  Urie  Bronf enbrenner . 

NDCS  Phase  m  Design 

The  NDCS  was  conducted  in  57  day  care  centers  in 
three  sites.*    Atlanta,  Detroit  and  Seattle  „ere  chosen  as 
the  study  sites,  and  a  total  of  57  centers  subsequently  were 
selected  for  participation.     The  centers  were  selected  for 
high  or  low  values  of  staff/child  ratio,  group  size  and 
staff  education.    The  first  year  following  site  selection 
was  a  study  of  naturally  existing  relationships  between 
regulatable  center  characteristics  and  measures  of  classroom 
process,  including  caregiver  observations.    This  phase  of 
the  study  was  used  to  (1)   formulate  initial  hypotheses  about 
relationships  among  regulatable  center  characteristics, 
classroom  process  and  developmental  outcomes;  and  (2)  refine 

*Site  and  center  selection  were  carried  out  during  Phase  i 
of^the  study,  July  1974  to  September  1975  (Abt  Alsoc?a?es, 


the  measures  of  regulatable  characteristics,  classroom 
process  and  developmental  outcomes  to  be  used  in  in  the 
third  and  final  year  of  the  study  (Travers,  Coelen,  and 
Ruopp,  1977)  • 

Phase  III  (October  1976  to  September  1977)  was 
designed  to  answer  the  study's  three  major  policy  questions 
(Travers,  Coelen,  and  Ruopp,  1977).  The  Phase  III  investi- 
gation had  two  components:     a  quasi-experiment  conducted  in 
49  of  the  centers  in  all  three  sites,  and  a  randomized 
experiment  conducted  in  eight  centers  operated  by  the 
Atlanta  Public  Schools  (APS) .     The  eight  APS  centers  were 
not  included  in  the  49-center  sample.     In  both  studies, 
selected  center  characteristics  were  altered  systematically, 
permitting  measurement  of  the  effects  on  caregiver  behavior 
associated  with  such  changes. 

49-Center  Study 

The  quasi-experiment  in  49  of  the  centers  was  a 
comparison  of  three  groups  of  centers  (Figure  1.1).    Group  I 
(the  ••treatment"  group)  consisted  of  14  centers  which  had 
low  observed  staff/child  ratios  (1:9.1)   in  Phase  II,  and 
whose  ratios  were  increased  to  1:5.9  in  Phase  III.*  Effects 
of  this  treatment  on  caregivers  and  children  were  compared 
with  results  from  a  matched  group  of  14  untreated  centers 
with  naturally  low-ratio  (1:9.1),  labeled  Group  II,  and  a 
group  of  21  untreated  centers  with  naturally  high  ratio 
(1:5.9),  labeled  Group  III.     The  question  of  central  interest 
in  the  quasi-experiment  was  whether  the  experimentally-induced 
increase  in  staff/child  ratio  would  produce  different 


*Note  that,  in  conformance  with  HEW  directives,  manipulations 
consisted  only  of  making  low  ratios  higher.    The  Group  I 
treatment  simulates  one  potential  effect  of  full  enforcement 
of  FIDCR  under  Title  XX — namely  an  increase  in  ratios  in 
centers  serving  publicly  funded  children  but  currently 
operating  below  FIDCR  ratios. 
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Figure  l.l 

DESIGN  OF  THE  49-CENTER  QUASI-EXPERIMNENT 


Group  I 


Treated  centers 

(Observed  mean  ratio  for  14  centers 
1:9.1  in  Phase  II;  ratio  raised  to 
1^5.9  in  Phase  III) 


Group  II  - 


Untreated  low-ratio  centers 
(Observed  mean  ratio  for  14  centers 
1:9.1) 


Group  III  -  Untreated  high-ratio  centers 

(Observed  mean  ratio  for  21  centers 
=  1:5.9) 
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caregiver  behaviors  than  were  seen  in  the  matched  low-ratio 
centers  (Group  I  vs.  Group  II).     A  supplementary  question 
was  whether  the  treated  and  untreated  high-ratio  centers 
(Group  I  and  II)   looked  different.     That  is,  would  the 
experimental  increase  in  ratio  eliminate  most  or  all  differ- 
ences between  centers  that  previously  operated  at  different 
ratios,  or  would  differences  in  outcomes  continue  to  exist, 
presumably  because  of  other  center  characteristics  that 
normally  accompanied  high  ratios  but  were  unaffected  by 
the  experimental  increase  in  ratio? 

Ratio  was  chosen  for  manipulation  because  of  its 
critical  policy  relevance;  manipulation  would  reduce  any 
confounding  between  ratio  and  other  center  characteristics, 
permitting  clearcut  assessment  of  its  effects.    Group  size, 
caregiver  experience  and  years  of  education  were  distributed 
as  evenly  as  possible  across  the  three  experimental  groups, 
so  that  the  effect  of  ratio  could  be  clearly  separated  out. 
No  attempt  was  made  in  the  quasi-experiments  to  alter 
natural  variations  in  age-grouping.  The  three  sets  of  ratios 
applied  to  classrooms  that  served  primarily  three-  and 
four-year  old  children.     In  some  centers,  three-year  olds 
were  clearly  separate  from  four-year  olds;   in  others,  the 
two  ages  were  mixed  in  the  same  classroom. 

APS  Study 

The  APS  Study  was  an  eight-center,  29-classroom 
experiment  in  which  children  yjera  randomly  assigned,  within 
centers,  to  classrooms  that  differed  systenatically  in 
level  of  staff  education  and  staff/child  ratio  (Figure  2). 
Group  size  and  caregiver  experience  were  distributed  as 
evenly  as  possible  acrosj  the  three  experimental  groups. 
Twelve  of  the  experijriental  classroom?  served  thr?;e-year  old  ' 
children,  and  seventeen  served  four-year  olds.     This  design 
made  possible  a  relatively  clearcut  assessment  of  the  effects 
and  interactions  of  staff  education  and  staff/child  ratio 
for  children  of  different  ages  (three-  and  four-year  olds). 
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Figure  1.2 


DESIGN  OF  THE  ATLANTA  PUBLIC  SCHOOLS  (APS) 
EIGHT-CENTER  EXPERIMENT  


High  Ratio  Low  Ratio 

(Observed  (Observed 


Mean  Ratio  =  Mean  Ratio  = 

IlLlH  1;7.4) 


High  Staff 

Education  4  classrooms  4  classrooms 

Medium  Staff 

Education  7  classrooms  4  classrooms 

Low  Staff 

Education  6  classrooms  4  classrooms 
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staff  in  the  APS  centers  fell  into  three  distinct 
categories  of  educational  background.     First,  center  directors 
(who  were  required  to  work  in  classrooms  as  well  as  to 
function  as  directors)  had  bachelor's  degrees;  most  also  had 
master's  degrees.     Second,  lead  teachers  were  graduates  of 
the  Atlanta  Area  Technical  School  (AAT)   two-year,  post-secon- 
dary training  program  ia  day  care  or  had  completed  at  least 
two  years  of  college.     Third,  aides  generally  had  high 
school  diplomas   (or  an  equivalent  suchas  the  G.E.D.);  the 
majority  of  aides  had  also  completed  the  60-hour,  state- 
required  training  courses  in  day  care  offered  through  AAT. 
As  shown  in  Figure  1.2,  persons  at  these  three  levels  of 
education  were  assigned  to  be  lead  teachers  in  the  experimental 
APS  classrooms — sqme  in  classes  with  relatively  high  staff/ 
child  ratios,  others  in  classes  with  lower  ratios.  Thus, 
ratio  and  education  were  crossed  in  a  two-way  factorial 
design.     Children  were  then  randomly  assigned  within  centers 
to  these  experimentally  organized  classes.     Random  assignment, 
together  with  the  fact  that  the  children  served  by  APS 
centers  were  unusually  homogeneous  in  ethnic  and  socioeconomic 
background  (virtually  all  were  black  children  from  low-income 
families)  minimized  any  confounding  of  center  characteris- 
tics and  children's  background  characteristics. 

The  two  Phase  III  components  addressed  the  same 
questions  but  had  designs  with  different  experimental 
strengths  and  weaknesses.     Because  the  49-center  study 
included  a  large  and  diverse  group  of  centers  in  three 
different  sites,  its  results,   if  uniform  across  the  sample, 
were  likely  to  be  widely  generalizable;  however,  the  diver- 
sity of  the  sample  also  posed  challenges  for  analysis  and 
interpretation.     The  APS  study  provided  a  greater  degree  of 
experimental  control  and  afforded  more  safeguards  against 
confounding  of  center  characteristics  with  characteristics 
of  the  children,  families  or  communities  served.  However, 
the  generalizability  of  its  results  was  potentially  limited 
by  the  homogeneity  of  the  sample. 
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CHAPTER  TWO;     THE  CHILD  FOCUS  INSTRUMENT 


Behavior  of  young  children  in  day  care  is  varied 
and  volatile— much  more  so,  for  example,  than  behavior  of 
children  in  elementary  school  settings.     The  NDCS  required 
an  observation  instrument  and  analytic  approach  that  could 
do  justice  to  this  complexity,  yet  yield  a  manageable  set 
of  behavior  descriptors  that  reliably  characterized  children, 
classes  or  centers  along  dimensions  relevant  for  assessing 
quality.     The  Child-Focus  Instrument  (CFI) ,  used  in  the 
NDCS  for  naturalistic  observation  of  children,  was  based 
on  the  Child  Observation  System  developed  by  Elizabeth 
Prescott  (Prescott,  Jones,  Critchersky,  Milich,  and  Hazelhoef, 
1975).     SRI  selected  the  Prescott  instrument  after  reviewing 
several  alternative  systems  and  conducting  field  tests  of 
the  most  promising  candidate  instruments  during  Phase  I 
(Stallings,  Wilcox  and  Travers,  1976)     The  Prescott  instrument 
was  attractive  be.cause  it  had  been  developed  specifically 
for  preschool  children  in  day  care  settings  and  because  it 
had  been  used  for  research  purposes  quite  close  to  those  of 
the  NDCS  (Prescott,  et  al.,  1975).    The  system  includes  a 
large  number  of  behavior  codes,  many  of  which  are  highly 
specific  and  have  a  fairly  high  degree  of  face  validity  and 
objectivity.    SRI  was  able  to  train  observers  to  high  levels 
of  accuracy  for  almost  all  codes,  both  in  initial  field 
testing  and  in  subsequent  use  during  Phases  ll  and  m. 

The  CFI  was  modified  several  times  in  the  course 
of  the  NDCS;  the  version  described  here  is  the  one  used  in 
Phase  III  (Stallings  and  Broussard,  1977).     Each  child 
observation  consists  of  a  twenty-minute  period,  broken  into 
100  twelve-second  coding  intervals.     Observers  were  provided 
with  timers  that  click  every  twelve  seconds  and  instructed 
to  record  the  behavior  of  a  preselected  focus  child  at  the 
time  of  each  click.     Each  record  or  frame  has  three  parts: 


•  a  section  containing  one  of  50  codes  charac- 
terizing the  child's  principal  behavior  during 
the  12-second  coding  interval.     These  include 
37  activity  codes,  used  when  the  child  engages 
in  some  form  of  overt  action^  and  13  "receives" 
codes »  used  when  the  major  event  during  the 
coding  interval  is  an  initiative  directed 
toward  the  child  by  some  other  person^  e.g., 

a  request,  praise  or  correction.  Additional 
codes  accompany  some  of  the  "receives"  codes 
to  indicate  whether  the  child's  response  is 
appropriate. 

•  a  section  containing  four  object  codes  (adult, 
child,  group  of  children,  or  environment), 
indicating  the  person(s)  or  thing(s)  toward 
which  the  focus  child's  attention  is  directed; 
and 

•  a  section  containing  three  activity  continuity 
codes,  indicating  whether  the  child's  behavior 
is  a  new  activity,  an  old  activity,  or  no 
identifiable  activity  at  all. 


Table  2-1  lists  the  codes  and  shows  their  relative  frequen- 
cies of  occurrence  in  the  Phase  ill  data,  i.e.,  their  fre- 
quencies as  percentages  of  all  725,000  frames  recorded  in 
fall  and  spring.*    Definitions  of  the  more  important  codes 
are  provided  immediately  below.     Description  of  the  data 
base  and  data-gathering  procedures  appear  in  the  following 
section. 


Many  of  the  CFI  codes  shown  in  Table  2.1  are  specific 
and  self-explanatory.     However,  some  of  the  most  frequently 
occurring  codes  (e.g.,  "shows  closed,  structured  activity") 
are  broader  and  require  some  explication.    The  following 
definitions  of  the  most  common  activity  and  "receives"  codes 
have  been  excerpted  from  SRI*s  training  manual; 


♦Frequencies  of  the  activity  continuity  codes  indicating 
old  vs.  new  activities  are  not  shown  directly  in  the  table. 
By  a  procedure  outlined  in  the  later  section  on  construc- 
tion of  dependent  variables,  these  two  codes  were  used  to 
compute  the  duration  of  the  child's  longest  single  activity 
during  the  20-minute  observation  period.    The  latter  figure 
is  shown  in  the  table. 
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Table  2*1 

FREQUENCIES  OF  CHILD  OBSERVATION  CODES^ 
(FALL^   1976  AND  gpRING^  1977} 

A,     Activity  codes  Percent  of  All  Frames 

Group  closed,  structured  activity  21  1 

Group  open,  expressive  activity  13*2 

Monitors  environment  (looks,  watches)  ii*q 

Gives  opinions  g  ^ 

Wanders  aimlessly,  does  nothing  ^\ 

Group  passive  activity  40 

Moves  with  purpose  3  ? 

Individual  open,  expressive  activity  2*9 

Adds  prop  or  idea  2  8 

Considers,  contemplates  problem  1*7 

Individual  closed,  structured  activity  1*5 

Gives  orders,  directs  others  in 

Intrudes  playfully  ^  q 

Asks  for  attention  q  g 

Selects  activity  (with  others)  n'fi 

Shares,  helps  yl 

Asks  for  information  n\ 

Asks  for  turn  n  ^ 

Selects  activity  (alone)  n  t 

Isolates  self  "'^ 

Asserts  rights  n  :: 
Cries 

Sees  pattern,  solves  problem  q\ 

Intrudes  hostilely,  bullies  0  1 

Hostilely  asserts  rights,  anger  n*i 

Hostile  exchange        ^      '      ^  oa 

Avoids,  withdraws  q  | 

Individual  passive  activity  0  1 

Asks  for  assistance,  help  0*1 

Offers  sympathy,  comfort  0  i 

Asks  for  comfort  q  , 

Intrudes  unintentionally  o*i 

Experiences  rejection  0  1 

Quits  activity  after  frustration  <o  1 

Angry  reaction  to  frustration  ^n'l 

Experiences  accident  i 

Temper  tantrum  ^0  J 
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Participates  in  group  activity— closed  . 

structured; Focus  child  and  others  are  in- 
volved in  an  activity  that  has  a  goal,  ciear 
guidelines  for  carrying  out  the  task,  and  a 
defined  beginning  and  end.     Focus  child's 
participation  in  adult-directed  group  activi- 
ties IS  coded  here.     (The  presence  of  other 
children  in  the  activity  differentiates  this 
code  from  individual  structured  activity, 
discussed  below.)     Examples:     child  is  part 
of  a  group  playing  musical  chairs;  or  child 
and  a  friend  are  working  together  to  clean 
off  the  table. 

Participates  in  group  activity— open-ended , 
expressive; Focus  child  participates  with 
others  in  a  mutual  experience  that  has  no 
goal,  no  external  guidelines  or  defined  point 
of  completion;  the  structure  of  the  activity 
IS  determined  by  those  involved,  not  by  the 
materials.     (The  presence  of  other  children 
in  the  activity  differentiates  this  code  from 
individual  open-ended  activity,  discussed 
below.)     Examples;     Child  is  playing  with 
other  children  in  the  block  corner;  or  child 
and  another  child  are  swinging  alongside  each 
other,  making  a  game  of  who  can  swing  higher. 

Monitors  environment  (looks,  watch^si ;  focus 
child's  attention  is  obviously  directed  at 
other  people  or  things.    This  code  is  not  used 
tor  listening.     The  focus  child  may  be  either 
'^v^^k"^  of  an  activity.    The  object  code  used 
with  this  code  identifies  the  focus  of  the 
child's  attention.     Examples;     Child  stands 
apart  from  a  group  of  children,  watching  them 
play;  or  child  is  playing  at  the  block  table; 
his  attention  is  directed  to  an  adult  cleaning 
up  some  spilled  paint. 

^'""f.^  preferences,  information,  comments: 

Focus  child  initiates  statements  about  his  own 
iiKes,  dislikes  or  preferences.     This  code 
also  includes  information  and  comments  initi- 
ated by  the  focus  child  (not  in  response  to  a 
question) .     Examples:     "i  went  on  a  picnic 
yesterday;"  or  "Johnny  is  my  best  friend." 

Does  nothing,  wanders;     Focus  child  wanders  around 
center  with  no  apparent  purpose  to  his  movement. 
He  may  be  sitting  or  standing  doing  nothing, 
looking  around  the  area  with  no  apparent  focus. 
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Examples:     Child  wanders  from  sandbox  to  slide 
and  then  to  doll  corner,  not  concentrating  on 
anything  or  anyone. 

Participates  in  group  activity — passive  attention; 
Focus  child  is  part  of  a  group  that  is  involved 
in  an  activity  which  requires  .10  visible 
response,  but  does  require  concentration  or 
thought.     (The  presence  of  other  children  in 
the  activity  differentiates  this  code  from 
monitoring  the  environment,;       Examples:  Chilu 
and  other  children  are  watching  a  puppet  show; 
or  child  is  part  of  a  group  that  is  watching 
TV;  or  child  is  part  of  a  group  to  which  an 
adult  is  reaaing  a  story. 

Moves  with  purpose;     This  code  is  used  when  the 
focus  child  is  going  from  one  activity  to 
another  or  whenever  it  seems  evident  that  there 
13  some  goal  to  his  movement.     Examples:  Child 
has  just  finished  gluing  on  a  piece  of  paper; 
he  heads  for  the  bathroom  to  wash  his  sticky 
hands;  or,  child  notices  that  a  swing  is  free 
and  runs  across  the  yard  toward  it. 

Individual  open-ended,  expressive  activity:  Focus 
child  is  involved  in  an  activity  that  has  no 
defined  goal,  external  guidelines,  or  defined 
point  of  completion;  the  structure  of  the 
activity  is  determined  by  the  child.  Other 
children  do  not  share  in  this  activity  with  the 
focus  child — he  is  alone.     Examples:     Child  is 
playing  with  blocks;  or  child  is  dancing  alone 
to  a  record. 

Adds  a  different  prop  or  new  idea;     Focus  child 
adds  variety  to  his  activity.     He  uses  a  dif- 
ferent toy  or  prop  from  the  one  he  was  using 
previously  in  the  same  activity,  or  he  uses  the 
same  prop  in  a  different  way.     This  code  is 
also  used  when  the  focus  child  resumes  play 
with  an  article  that  he  used  formerly  in  the 
same  activity.     Examples:     child  adds  a  differ- 
ent color  to  his  painting;  or  child  is  washing 
dishes  in  the  doll  corner,  then  picks  up  a  doll 
and  washes  it. 

Considers,  contemplates,  tinkers:     Focus  child 
considers  before  making  a  selection  of  materi- 
als.    Focus  child  tries  out  an  object,  looks  at 
it,  moves  it,  examines  it,  manipulates  it. 
Focus  child  struggles  with  a  problem,  attempt- 
ing to  solve  it.     Examples:     Child  carefully 
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examines  a  truck,  checking  out  each  moving 
part;  or  child  pulls  on  cargo  net  and  watches 
how  the  net  moves  in  response  to  his  pull. 

Individual  structuredr  closed  activity;     Focus  chi 
is  involved  in  an  activity  which  has  a  goal, 
clear  guidelines.     Other  children  do  not  share 
m  this  activity  with  the  focus  child.  Exam- 
ples;    Child  is  stringing  beads  for  a  necklace; 
or  child  is  working  on  a  puzzle;  or  child  is  ^ 
alone  at  a  table,  grating  cheese  for  a  pizza. 

Receives  orders  or  minor  behavioral  corrections; 
Focus  child  receives  commands  with  which 
compliance  is  expected.     This  code  also  in- 
cludes orders  to  maintain  smooth  operation  of 
the  center  and  minor  behavioral  corrections. 
Examples;     Adult  tells  child  to  put  books  away; 
or  another  child  says  to  focus  child,  "Let  me 
have  the  trike  now." 

Receives  information/help  with  a  task;  Focus 
child  receives  instruction,  materials,  or 
assistance  related  to  his  task  or  the  solution 
to  his  problem.     This  code  includes  verbal  and 
nonverbal  assistance  or  demonstration.  Also 
included  in  this  code  are  preliminary  direc- 
tions and  review  of  an  activity.  Examples; 
Child  is  having  difficulty  completing  his 
puzzle  and  the  teacher  shows  him  where  the 
piece  goes;  or  adult  is  telling  focus  child  how 
to  clean  paint  brushes. 

Receives  general  comments,  questions;     Focus  child 
IS  asked  for  information  or  receives  comments  of 
a  general  nature.     Examples;     Adult  says  to 
child,  "Today  is  Johnny's  birthday";  or  another 
child  tells  focus  child,  "My  grandma  made  this 
dress. " 

As  shown  in  Table  2.1,  recorded  frequencies  of  the 
behavior  codes  varied  widely,     m  Phase  III,  the  eleven 
activity  codes  and  three  "receives"  codes  defined  above 
occurred  more  than  once  per  20-minute  observation  (i.e., 
more  than  one  percent  of  the  time).     Most  analyses  reported 
in  later  sections  are  based  on  these  common  codes  and 
combinations  thereof.     However,  many  codes  of  psychological 
interest  occurred  rarely—a  few  times  per  thousand  frames. 
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or  less.  Many  of  the  latter  were  events  that  are  potentially 
important  as  indicators  of  harm;  a  few  were  potential 
indicators  of  benefits  of  day  care.     Examples  include  the 
codes  "cries,"  "isolates  self,"  "refuses  to  comply,"  "experi- 
ences accident,"  "shares  or  helps,"  and  a  number  of  codes 
indicating  anger  or  hostility. 

There  are  several  possible  reasons  for  the  low 
frequencies  of  these  events.     One  is  that  frequencies  of 
events  recorded  with  a  time-sample  instrument  such  as  the 
CPI  depend  partially  on  the  durations  of  those  events.  If 
psychologically  important  events  are  brief,  they  will  appear 
in  few  frames  or  be  missed  altogether.     For  example,  a  h-ug 
or  a  slap  may  last  less  than  a  second.     When  such  events 
occur  they  are  likely  to  be  very  important  to  the  children 
involved  and  memorable  for  an  adult  who  happens  to  witness 
them.    Yet  a  time  sampling  record  of  a  day  in  which  one 
such  event  occurs  will  show  that  the  event  occupied  a  tiny 
fraction  of  the  observation  period,     in  contrast,  more 
commonplace  activities  such  as  game  pl?.ying  or  story  telling 
would  occupy  a  much  greater  portion  of  the  day. 

A  second  reason  concerns  limited  opportunities  for 
children  to"  display  behaviors  that  meet  the  definitions  of 
relevant  codes.     For  example,  sharing,  taking  turns  and 
helping  with  minor  tasks  are  routinized  in  most  centers. 
Routinized  prosocial  behavior  is  coded  as  a  form  of  group 
activity,  or  as  compliance  with  adult  requests,  rather  than 
as  voluntary  helping  or  sharing,  accounting  for  the  rarity 
of  this  particular  code.     Similarly,  most  centers  are  organ- 
ized to  prevent  conflict  and  to  terminate  it  quickly  when  it 
occurs.     To  the  degree  that  they  succeed,  "opportunities" 
for  conflict  are  limited,  and  associated  codes  are  rare. 

The  rarity  of  important  codes  was  addressed  in  two 
ways.     First,  rare  codes  from  the  natural  observations  were 
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analyzed  separately  from  more  frequent  codes,  using  a  form 
of  statistical  analysis  more  appropriate  for  rare  events 
than  ordinary  regression.     Second,  in  addition  to  natural 
classroom  observations,  children  were  observed  in  structured 
situations  designed  to  provide  greater  opportunity  for 
voluntary  prosocial  behavior  such  as  helping  and  sharing. 
Results  of  both  approaches  are  presented  in  this  report 
following  discussion  of  the  main  analyses  and  results. 

Phase  III  Sample  and  Procedures 

The  study  design  called  for  each  child  to  be 
observed  four  times  for  a  total  of  eighty  minutes  in  both 
fall  and  spring—three  times  in  natural  situations  (pri- 
marily free  play  and  teacher-directed  activity)  and  once 
in  a  pair  of  structured  situations.     In  the  spring,  natural 
observations  were  conducted  by  two  different  observers 
for  each  child— generally  one  black  and  one  white  observer 
—in  order  to  permit  analytic  separation  of  actual  behav- 
ioral differences  among  children  from  differences  in  per- 
spective among  observers.     SRI  was  able  to  implement  the 
design  with  substantial  success,  as  the  following  data 
indicate. 


Approximately  8,300  twenty-minute  observations 
of  target  children  were  completed  by  SRI's  observers.  The 
distribution  of  observations  between  time  points  and  between 
natural  (classroom)  and  structured  observations  is  shown  in 
Table  2.2.    Numbers  of  children  and  classrooms  observed  are 
also  shown  in  the  table.     Of  1,108  children  observed  in 
the  spring,  1,086  had  been  observed  in  the  fall.    At  both 
times,  the  sample  was  approximately  evenly  divided  among 
Atlanta  Public  School  centers,  Atlanta  centers  outside 
the  public  schools,  Detroit  centers  and  Seattle  centers. 
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Table  2.2 
PHASE  III  CHILD  OBSERVATION  SAMPLE 


Fall  1976 


Spring  1977 


Natural  (Classroom)  Observations 
Number  of  Observations 
Number  of  Children 
Number  of  Classrooms 


3,987 
1,310 


117 


3,177 
1,108 
116 


Structured  Observations 
Number  of  Observations 
Number  of  Children 


1,284 


642 


1,046 


523 


In  both  fall  and  spring,  natural  observations 


took  place  in  four  general  types  of  situations:     free  play, 
adult-directed  activity  (including  both  individual  and  group 
activities,  with  the  latter  predominant),  routine  center 
activities  (cleanup,  snack,  toileting,  etc.)  and  multiple 
activities — combinations  of  two  or  more  of  the  preceding 
types  occuring  within  one  twenty-minute  observation.  By 
design,  free  play  and  teacher-directed  activities  were 
observed  most  frequently.    As  shown  in  Table  2.3,  about  38 
percent  of  fall  observations  and  41  percent  of  spring 
observations  took  place  during  free  play  periods;  42  percent 
of  fall  observations  and  41  percent  of  spring  observations 
occurred  during  teacher-directed  activities.     Since  the 
dynamics  of  the  group  can  change  dramatically  across  these 
general  types  of  situations,  separate  analyses  were  conducted 
for  data  from  free  play  and  teacher-directed  periods. 
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Table  2.3 

CHILD  FOCUS  OBSERVATION  SITUATIONS 
(percentages) 

Fall  1976  Spring  1977 

Free  Choice 
Center  routine 
Adult-directed  individual 
Adult-directed  group 
Principle  types 


38% 
10 
4 
38 
10 


41% 
9 
3 
38 
9 
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CHAPTER  THREE;     OBSERVER  TRAINING  AND  RELIABILITY 


Of  all  threats  to  the  validity  and  reliability 
of  observation  instruments,  the  one  that  has  received  the 
most  attention  in  the  psychological  literature  is  distortion 
of  results  due  to  differences  in  observer  perspective. 
Characteristically,  considerable  effort  is  devoted  to 
training  observers  to  high  criteria  of  agreement,  and  often, 
when  such  standards  are  achieved,  the  researcher  assumes  that 
his  or  her  measures  are  trustworthy.    Although,  as  shown  in 
the  next  section,  the  importance  of  observer  effects  is 
usually  overated  and  high  observer  agreement  is  no 
guarantee  that  measures  are  dependable,  observer  effects 
nevertheless  deserve  careful  attention. 

The  first  line  of  defense  against  observer  effects 
lies  in  training.     SRI  recruited  and  trained  observers  care- 
fully and  tested  their  performance  on  selected  videotaped 
samples  of  behavior  before  and  after  sending  them  into  the 
field.     In  addition,  a  small-scale  study  of  interobserver 
agreement  under  field  conditions  was  conducted.     All  results 
indicated  that  satisfactory  levels  of  agreement  had  been 
established  and  maintained  (Stallings  and  Broussard,  1977). 

A  particularly  sensitive  issue  having  to  do  with 
observer  effects  arose  early  in  Phase  III,  when  late  Phase 
II  analyses  suggested  that  there  might  exist  systematic 
differences  in  perspective  linked  to  the  race  of  the 
observer.    The  existence  of  these  effects  could  not  be 
regarded  as  proven,  because  race  of  observer  was  partially 
confounded  with  the  race  of  the  child  or  caregiver  under 
observation  and  with  various  center  characteristics. 
Nevertheless,  to  guard  against  possible  distortions  due  to 
race  of  observer.  Phase  III  spring  observation  procedures 
were  modified.     According  to  the  modified  plan,  every  child 
was  to  be  seen  by  two  different  observers,  one  black  and  one 


132 


158 


White.     This  modification  was  strongly  urged  by  black  con- 
sultants to  the  NDCS  (Stallings  and  Broussard,  1977).  Des- 
pite formidable  difficulties  of  recruitment  and  scheduling, 
SRI  came  close  to  full  implementation  of  the  plan  (Table 
3.1).     This  procedure  eliminated  any  confounding  between 
policy  variables  and  race  of  observer.    Moreover,  it  made 
possible  a  much  more  precise  estimate  of  the  magnitude  of 
observer  effects  than  would  otherwise  have  been  possible. 
These  estimates  played  an  important  role  in  broader  investi- 
gations of  the  reliability  of  the  study's  observation  measures. 

SRI  hired  and  trained  46  observers  in  both  fall 
and  spring.     Each  time  nine  observers  conducted  structured 
observations  exclusively,  while  the  remaining  37  conducted 
natural  observations  in  classrooms.     Between  fall  and 
spring,  the  number  of  observers  who  were  members  of  minority 
groups  was  increased  from  12  to  20,  or  44  percent  of  the 
total.     These  particular  observers  completed  44  percent  of 
all  observations,  close  to  the  50  percent  ideally  required 
by  the  study  procedures.    A  minimum  of  30  percent  of  obser- 
vations in  each  center  was  conducted  by  minority  observers. 
All  observers  were  female.    Distributions  of  age  and  educa- 
tion were  fairly  similar  across  sites;  most  observers  were 
college  graduates  between  30-35  years  of  age. 

Training  of  Observers* 

Each  observer  trainee  received  a  home  training  kit 
a  few  days  before  the  observation  training  began,  including 
a  manual  of  code  definitions,  a  detailed  explanation  of  the 
coding  procedures,  and  a  sample  coding  sheet. 

Observers  who  had  not  collected  child  focus 
observation  data  at  any  previous  time  attended  training 
sessions  for  seven  days.     Experienced  observers  joined  the 


*This  section  summarized  from  Stallings  and  Broussard,  1977, 
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Table  3.1 

CHILD  FOCUS  OBSERVER  CHARACTERISTICS 


Fall  1976 

Classroom  Percent  Average       Average  Years 

Observations  Number      Minority  Age           of  Education 

Atlanta  19  32                 35  17 

Detroit  10  30                 38  16 

Seattle  8  12                29  17 

Structured 
Observations 

Atlanta  5  40                 32  17 

Detroit  2  50                 37  16 

Seattle  2  0                 31  17 

Spring  1977 

Classroom 
Observations 

Atlanta  20  50                 36  16 

Detroit  10  50                 35  16 

Seattle  7  29                 33  16 

Structured 
Observations 

Atlanta  5  40                 35  16 

Detroit  2  50                 32  16 

Seattle  2  0                 31  16 
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trainers  were  paired  in  different  combinations  to  form  teams 
at  the  three  sites. 

At  the  conclusion  of  the  training  sessions,  the 
performance  of  child  focus  trainees  was  assessed  by  means  of 
a  criterion  videotape.     The  trainees  recorded  115  examples 
of  child  behavior  from  the  criterion  videotape  and  97 
examples  from  the  same  videotape  after  they  had  been  observ- 
ing in  the  field  for  two  weeks.     Recordings  of  all  observers 
who  completed  training  were  compared  frame-by-frame  with  the 
criterion  videotape.     Those  frames  on  the  tape  that  were 
coded  incorrectly  by  50  percent  or  more  of  the  observers 
were  deleted  from  the  data.     After  the  bad  frames  were 
deleted,  observer  scores  were  computed  as  percent  agreement, 
with  the  criterion  established  by  the  SRI  trainers.  Forty- 
five  of  51  trainees  passed  the  original  criterion  videotape 
testing  (passing  score  was  75%  or  higher). 

In  general,  observers'  scores  improved  somewhat 
from  pretest  to  posttest.     All  of  the  42  observers  who 
participated  in  the  retesting  session  scored  80  percent 
correct  or  better  at  that  time,  and  mean  accuracy  was  93 
percent,     in  addition,  SRI  conducted  a  field  test  of  inter- 
rater  agreement  to  address  the  issue  of  racial  differences 
in  coding  patterns  that  had  arisen  in  Phase  II.  Seventeen 
pairs  of  observers  were  formed,  each  with  one  black  and  one 
white  member.     Each  pair  coded  the  activities  of  the  same 
child  for  one  hour.     Interobserver  comparisons  were  possible 
for  45  activity  codes,  of  which  only  three  showed  significant 
differences  in  overall  frequency  between  black  and  white 
observers.     Training  of  observers  and  results  of  various 
tests  of  observers'  accuracy  are  described  in  more  detail  in 
SRI's  Phase  m  report. 
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Reliability  of  Child  Observation  Codes 


Effects  analyses  of  the  CFI  were  aimed  primarily 
an  determining  to  what  extent  variations  in  child  activities 
cinu  behavior  are  related  to  variations  in  group  size,  staff/ 
child  ratio  and  caregiver  qualifications.    A  determination 
of  the  reliability  of  the  CFI  codes  was  an  important  step  in 
the  development  of  analytic  strategy.     First,  estimates  of 
reliability  helped  in  setting  the  proper  unit  of  analysis  by 
identifying  the  level  of  aggregation — person  (child  or 
caregiver),  class  or  center — for  which  the  data  are  most 
reliable.     Second,  they  helped  establish  the  mathematical 
limits  of  the  analyses  to  be  performed — the  degree  of 
statistical  power  to  detect  relationships  and  the  degree  of 
bias  likely  to  be  present  in  estimating  the  strengths  of 
relationships.    When  reliability  coefficients  are  modest, 
meaningful  analyses  can  nevertheless  be  conducted  if  the 
sample  provides  enough  degrees  of  freedom.    However,  under 
such  circumstances,  genuine  but  small  relationships  may  not 
reach  conventional  levels  of  statistical  significance. 

While  most  researchers  who  use  observation-based 
measures  report  only  "inter-rater  reliabilities"  (usually 
percentages  of  agreement  or  correlations  between  scores 
generated  by  pairs  of  observers)  or  stabilities  of  measures 
across  occasions  (day-to-day  correlations) ,  other  mathematical 
techniques  have  been  developed  to  a  point  of  considerable 
sophistication.     The  essential  ideas  were  first  elaborated 
by  Medley  and  Mitzel  (1963)   and  have  been  most  fully  elabo- 
rated by  Cronbach,  et  al.,  (1972). 

The  reliability  pf  the  CFI  measures  was  assessed 
in  three  ways:     through  observer  agreement  (as  a  part  of  SRI 
training  described  above) ,  through  examination  of  the 
stability  of  the  measures  across  timepoints,  and  through 


components  of  variance  analysis.    In  general,  the  reliability 
analyses  indicated  that  the  measures  were  sufficiently 
reliable  to  support  the  effects  analyses  at  a  classroom 
level,  but  not  at  the  child  level,     with  all  observations 
for  a  group  aggregated,  a  significant  proportion  of  the 
variance  in  the  measures  will  be  expected  to  be  systematic 
and  potentially  explainable  by  the  policy  measures.    On  the 
other  hand,  the  analysis  indicated  that  the  key  NDCS  variables 
could  be  expected  to  account  for  only  moderate  proportions 
of  the  total  variation. 

Stability  from  fall  to  spring  and  from  free  play 
to  adult-directed  observation  periods  was  assessed  by 
computing  correlations  between  frequencies  of  the  same  code 
in  day  care  groups  at  different  times  (Table  3.2).  The 
overall  pattern  of  correlations  suggests  that  codes  were 
more  stable  in  the  fall  than  in  the  spring.    This  could  be 
due  to  a  clearer  differentiation  of  activities  by  springtime 
(when  the  group  had  been  together  for  six  months)  or  to  the 
fact  that  children  in  each  classroom  were  generally  seen  by 
a  single  observer  in  the  fall  but  at  least  two  observers  in 
the  spring.    As  might  be  expected,  stability  from  fall  to 
sring  was  lower  than  stability  across  observation  types 
within  a  data  collection  period.     Most  relationships  were 
statistically  significant  at  a  moderate  level,  however, 
suggesting  that  underlying  stability  is  found  for  these 
codes.    The  major  proportion  of  variation  in  child  behavior 
may  be  associated  with  factors  other  than  the  NDCS  policy 
measures  (for  example,  child  age  and  fmaily  background). 

Neither  interobserver  agreement  nor  stability  over 
time  conveys  all  of  the  information  needed  to  judge  the 
suitability  of  CFI  measures  for  use  in  effects  analyses. 
What  matters  is  how  well  the  measures  characterize  children, 
classes  or  centers  when  appropriately  averaged.     In  more 
technical  terms,  the  critical  element  is  the  relative 
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Table  3.2 


A.  Child  Activity  Codes 


CHILD  FOCUS  OBSERVATION  CODE  STATILITY; 
OBSERVATION  TYPE  AND  DATA  COLLECTION  PERTnn 

Free  Play/Teacher  Directed        Fall  1976/Spring  1977 

n  ,1  Teacher-Directed 
Pall  1976    Spring  1977      Free  Play  Activity 
N=117         N=116  N=114  N=114 


Group  structured  activity 
Group  open  activity 
Monitors  environment 
Gives  opinions 
Wanders,  does  nothing 
Group  passive  activity 
Moves  with  purpose 
Individual  open  activity 
Adds  prop  or  idea 
Considers,  contemplates  problem 
w         Individual  structured  activity 

Receives  general  comments 
Receives  information,  guidance 
Receives  demands,  requests 

B.  Object  Codes 

Attention  to  adults 
Attention  to  children 
Attention  to  groups 
Attention  to  environment 

C.  Activity  Continuity  Codes 

Longest  activity 
Not  involved  in  task 


27** 

ID 
•  10 

*12 

■  .16 

.41** 

.19 

.14 

.20* 

.38** 

.22* 

.21* 

.18 

.62** 

.32** 

•  .18 

.12 

.40** 

.51** 

.31** 

.26* 

.18 

.19 

.16 

.12 

.33** 

.20: 

.15 

.16 

.25* 

.14 

.13 

.23* 

.30** 

.16 

.17 

.18 

.34'* 

.38** 

.26* 

.20* 

.21* 

.18 

.U 

.22* 

.44** 

JO** 

.22* 

.18 

.28 

.35** 

,17 

.11 

.51** 

,37** 

.23* 

.n* 

^**P<.oi  I6f\ 

ERIC 


.43** 

.36** 

.43** 

.08 

.60** 

.35** 

.27** 

.30* 

.24* 

.27** 

.38** 

.27** 

.45** 

.25* 

.21* 

.16 

.07 

.06 

.08 

.10 

.50** 

.34** 

.44** 

.11 

importance  of  different  sources  of  variance  for  each  of  the 
CFI  measures.     The  more  variance  that  is  linked  to  other 
factors,  including  but  not  limited  to  observer  differences 
and  fluctuation  in  caregiver  behavior,  the  less  dependable 
is  the  measure  as  a  descriptor  of  the  chosen  unit. 

To  assess  the  relative  importance  of  the  major 
potential  determinants  of  CFI  scores,  a  variance  components 
analysis  was  performed  (singer,  Affholter  and  Goodrich, 
1978).     That  effort  revealed  that  for  all  of  the  CFI  codes 
analyzed,  the  occasion  of  observation  was  the  major  deter- 
minant of  variation,  followed  by  class  and  observer. 
Variation  at  the  child  level  contributed  little  to  the 
total.     However,  since  so  many  observations  were  conducted 
in  each  class,  the  group  agregate  values  are  considerably 
more  reliable.    Variance  associated  with  observers  is  a 
relatively  large  proportion  of  total  variance,  although  the 
influence  of  observer  variance  upon  group  aggregates  is 
reduced  in  the  spring  observation  due  to  the  use  of  multiple 
observers  in  each  classroom.     Reliabilities  of  selected  CFI 
codes  at  the  child  and  class  level  are  shown  in  Table  3.3. 
The  table  suggests  that  reliabilities  of  child  behavior  were 
extremely  low  at  the  child  level;  the  codes  did  not  appear 
to  describe  enduring  traits  or  stable  behavior  of  children. 
However,  the  measures  showed  class  level  generalizabilities 
that  were  adequate  for  effects  analyses,  given  the  degrees 
of  freedom  involved,    class  level  generalizabilities  ranged 
from  .14  to  .60,  clustering  in  the  neighborhood  of  .35. 

These  results  shaped  the  choice  of  units  of 
analysis  for  the  CFI.     In  addition,  they  provided  a  context 
for  interpreting  quantitative  findings.     The  results  sug- 
gested that  the  overall  explanatory  power  of  regression 
models  would  be  limited.     Even  if  very  strong  underlying 
relationships  between  the  policy  variables  and  dependent 
variables. were  to  exist,  generalizability  limitations  would 
restrict  the  explanatory  power  of  CFI  regression  models  such 
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that  even  r2»s  of  ,4  would  be  difficult  to  obtain,.  The 
larger  Implication  was  that  relatively  modest  relation- 
ships should  be  taken  seriously.    The  NDCS  was  a  search  for 
signals  In  a  noisy  environment;  a  signal  loud  enough  to 
detect  was  likely  to  be  stronger  than  It  seemed  against  the 
background  noise. 
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Table  3.3 

GENERALIZABILITIES  OF  CHILD  FOCUS  OBSERVATION  CODES 


A,    Child  Activity  Codes 


Group  structured  activity 


Attention  to  adults 
Attention  to  children 
Attention  to  groups 


Child  Class 


'05  .42 


Group  open  activity  ,o3  37 

Monitors  environment  ,o2  2I 

Gives  opinions  ^o7  ,52 

Wanders,  does  nothing  ,06  ,60 

Group  passive  activity  ,oo  .14 

Moves  with  purpose  ,05  ,46 

Individual  open  activity  ,01  ,19 

Adds  prop  or  idea  ,o4  ,44 

Considers,  contemplates  problem  ,03  ,32 

Individual  structured  activity  ,00  ,14 

Receives  general  comments  ,03  ,41 

Receives  information,  guidance  ,06  ,52 

Receives  demands,  requests  ,03  31 


B.     Object  Codes 


»03  ,34 
'02  ,31 
'03  .35 


Attention  to  environment  ,03  ,40 

C.    Activity  Continuity  Codes 


Longest  activity  ^qI 
Not  iivolved-~i4\  task 


.18 

'02  .27 
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CHAPTER  FOUR;     SELECTION  AND  CONSTRUCTION  OF  DEPENDENT 


MEASURES 


The  major  portion  of  the  effects  analysis  focused 


upon  fifteen  measures  of  child  behavior.     Eleven  of  these 
measures  are  frequently-occurring  individual  CFI  codes. 
Four  are  the  codes  denoting  the  object  of  the  child's 
attention — orientation  to  adults,  to  individual  children, 
to  groups  of  children  and  to  the  environment — which  are 
emphasized  because  they  describe  the  child's  global  inter- 
action patterns.     The  seven  other  individual  codes  included 
Verbal  Initiative,  Noninvolvement ,  Aimless  Wandering,  Task 
Persistence, ^Passive  Group  Time,  Environment  Monitoring,  and 
Purposeful  Movement.     The  four  remaining  dependent  measures — 
Reflection/Innovation,  Cooperation/Compliance,  Classroom 
Activity  Balance,  and  Interest/Participation — were  multicode 
measures  developed  for  the  analyses.     Definitions  of  the 
measures  are  described  below,  including  the  process  of  code 
construction.     The  general  measurement  strategy  was  to 
describe  behavior  in  the  day  care  center  as  comprehensively 
and  objectively  as  possible,  in  terms  of  fine-grained  codes. 
Data  were  then  reduced  by  combining  frequencies  of  codes 
that  were  conceptually  related  and  empirically  correlated. 
Efforts  were  made  to  create  summary  variables  that  bore  some 
relationship  to  constructs  previously  used  in  the  develop- 
mental literature,  but  primary  weight  was  placed  on  empirical 
patterns  evident  in  the  data. 

To  choose  appropriate  combinations  of  codes, 
frequencies  and  intercorrelations  of  the  various  codes 
were  examined,  at  all  levels  of  aggregation — child,  class 
and  center.     Data  were  also  examined  separately  for  fall 
and  spring,  for  the  Atlanta  Public  School  classrooms,  and 
for  the  three  sites  of  the  49-center  study. 
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In  addition,  .principal  components  analyses  were 
performed  on  child-  and  class-level  data  from  the  fall  and 
spring  samples,  in  an  independent  effort  to  reduce  the  set 
of  codes  to  a  few  summary  dimensions.    The  principal  compo- 
nents analysis  proved  unrevealing.    The  resulting  dimen- 
sions accounted  for  little  variance  and  were  not  readily 
interpretable.    Nor  were  they  especially  stable  from  fall 
to  spring.    Moreover,  some  "dimensions"  were  dominated  by 
one  or  two  particularly  frequent  codes.     Consequently,  con- 
ceptual coherence  and  simple  correlations  among  codes  were 
the  primary  bases  for  deciding  how  to  combine  codes  to 
form  broader  constructs,    where  individual  codes  were  suf- 
ficiently frequent,  important  and  distinctive  in  meaning 
from  other  codes,  they  were  treated  as  variables  in  them- 
selves.    (Again,  as  indicated  earlier,  some  infrequent  codes 
representing  psychologically  important  events  were  treated 
differently  and  are  discussed  separately.) 

Along  with  definitions  of  the  measures  that  follow, 
each  section  below  contains  information  on  the  consistency 
of  the  measure  across  adult-directed  and  free  play  activity 
periods  (indicating  the  degree  to  which  the  measures  char- 
acterize classrooms  rather  than  activity  segments  within 
classrooms).    Differences  in  behavior  frequency  in  children 
of  different  ages  are  reported,  and  selected  correlations 
among  the  measures  are  reported  wherever  these  help  clarify 
the  meaning  of  a  particular  measure.     Finally,  stabilities 
of  measures  from  fall  1976  to  spring  1977  are  also  reported. 
Stability  correlations  identify  those  constructs  for  which 
center  classrooms  retain  their  relative  frequency  rankings 
from  fall  to  spring,  as  opposed  to  those  constructs  for 
which  classrooms  shift  noticeably  in  relative  frequency 
ranks.     These  measures  give  some  indication  of  which  be- 
havior patterns  are  established  rapidly  during  the  day 
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care  year*  and  which  patterns  take  shape  gradually  from 
fall  to  spring.    However,  the  correlations  are  somewhat 
underestimated  because  of  changes  in  observation  procedures 
from  fall  to  spring  discussed  in  Chapter  Two  and  because  of 
shifts  of  enrollment  within  classes.** 

Reflection/Innovation 

Two  codes — CONSIDERS,  CONTEMPLATES  OR  TINKERS, 
and  ADDS  PROP  OR  IDEA  came  closest  among  all  CFI  codes  to 
capturing  thoughtful,  creative  problem-solving  behavior 
on  the  part  of  children.    Because  of  their  low  individual 
frequencies  and  positive  correlations  (.34  in  fall,   .30  in 
spring),  the  two  were  summed  to  form  a  statistically  more 
robust  variable,  REFLECTION/INNOVATION.     Frequencies  of  the 
construct  tended  to  be  consistent  across  activity  periods 
(r=.42,  p<.01  in  fall;  r=.37,  p<.01  in  spring)  but  were 
unstable  from  fall  to  spring. 

Verbal  Initiative 

The  single  code  GIVES  OPINIONS,  REFERENCES,  INFOR- 
MATION, COMMENTS  was  treated  as  a  separate  variable  indicat- 
ing the  degree  of  verbal  self-assertiveness  exhibited  by 


*  The  "day  care  year"  is  not  as  sharply  defined  as  the 

school  year,  with  a  clear  beginning  in  fall  and  in  spring. 
However,  formal  and  anecdotal  NDCS  data  from  both  the 
Supply  Study  and  main  cost-effects  study  show  that  there 
is  a  major  influx  of  new  children  in  the  fall,  accompanied 
by  an  exodus  of  children  who  have  reached  school  age. 
There  is  also  a  drop  off  of  enrollment  during  the  summer 
months. 

**Correlations  of  code  frequencies  between  free  play  and 
teacher-directed  activities  are  based  on  117  classrooms 
in  fall  and  116  in  spring.     Fall-spring  stability  corre- 
lations are  based  on  114  classrooms  that  existed  at  both 
time  points,  although  shifts  in  enrollment  occurred  within 
those  classrooms. 
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children  and  expected  or  accepted  by  caregivers.  Frequen- 
cies of  VERBAL  INITIATIVE  were  consistent  across  activity 
types  (r=.62,  p<.01  in  fall;  r=.32,  p<.01  in  spring)  but 
had  only  modest  fall-to-spring  stability  (r=.18,  p<.05  for 
free  play;  r=.12,  n.s.  for  adult-directed  activity) . 

Cooperation/Compliance 

Seven  of  the  RECEIVES  codes  are  accompanied  by 
supplementary  ^ odes  indicating  whether  the  child's  response 
is  appropriate.     The  seven  relevant  categories  of  action  or 
statement  directed  toward  the  child  are  (1)  general  comments, 
(2)   information  or  guidance,   (3)  requests  to  play  or  share, 
(4)  demands  or  requests  other  than  requests  to  play  or 
share,   (5)  rules  or  corrections,   (6)  punishment  or  threats, 
and  (7)  praise.     Percentages  of  appropriate  responses,  shown 
in  Table  4.1,  ranged  from  48  percent  for  punishment 
and  threats  to  87  percent  for  comments,  information  and 
guidance.     An  index  of  COOPERATION/COMPLIANCE  was  computed 
as  the  ratio  of  all  active  appropriate  responses  to  all 
instances  of  these  seven  RECEIVES  codes,     in  the  fall, 
older  children  showed  higher  frequencifss  of  COOPERATION/CCM- 
i^'-rX^-^  than  vounger  children  (p<.05S  but  no  age  differences 

TjviJent  m  spring— perhaps  ind  .eating  a  progressive 
soci6;;»zing  effect  for  younger  children.     Cooperation  was  at 
bes;^  .'^jrginally  consistent  across  activity  periods  (r=.ie, 
p<.Ob  in  fall;  r'-.08,  n.s.,  in  opring) .     Cooperation  during 
frse  p. ay  was  moderately  statue  from  fall  to  spring  (r=.25, 
P<.pr   out  cooperation  duriit.j  adult-directed  activity  was 
not  stable  (r=.06,  n.s.). 

Noninvolvement  (No  Task) 

The  degree  to    rhich    nildren  i-s  anlnvolved  in 
classroom  activities  is  direccly  recorded  by  the  activity 
continuity  code  NO  '  J.?K  ("Task"  is  broadly  defined  and 
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includes  play  and  exploration  as  well  as  teacher-assigned 
activities).    This  index  of  noninvolvement  was  consistent 
across  activity  types  (r«,50,  p<,01  in  fall;  r«,34,  p<,01 
in  spring)  and  was  stable  from  fall  to  sprTng  for  adult- 
directed  activity  (r«.44,  p<.01),  but  much  less  so  for 
free  play  (r«,ll,  n,s.). 

Aimless  Wandering 

Like  noninvolvement,  aimless  wandering — measured 
by  the  frequency  of  the  code  DOES  NOTHING,  WANDERS — is  an 
index  of  the  degree  to  which  children  are  not  engaged  in 
claesrcom  activities.     The  two  variables  are  correlated 
(r=.23,  p<.01,  for  free  play,  and  r=.45,  p<,01,  for 
teacher-directed  activity).     However,  the  two  were  not 
^ filmed  to  form  a  single  construct  because  they  were  incom- 
mensurate.    DOES  NOTHING,  WANDERS  was  an  activity  code,  one 
of  50  possible,  whereas  NO  TASK  was  a  continuity  code,  one 
of  three  possible.     NO  TASK  was  often  recorded  along  with 
DOES  NOTHING,  WANDERS,  accounting  in  part  for  their  corre- 
lation and  rendering  their  sum  meaningless.     The  frequency 
of  AIMLESS  WANDERING  was  consistent  across  activity  types 
(r=.40,  p<.01  in  the  fall,  and  r=.52,  p<.01,  in  the  spring) 
and  was  moderately  stable  from  fall  to  spring   (r=,28,  p<.01 
for  all  activity  types  pooled). 

Task  Persistence 

The  concepts 
span"  commonly  refer  to 
devote  sustained  effort 
young  child's  capacity 
Important  goal  of  early 
on  task  persistence  and 
than  on  closely  related 
namely  demands ^'made  and 


"task  persistence"  ano  attention 
a  child's  tendency  or  ability  to 
to  a  single  pursuit.     Increasing  the 
in  this  area  is  often  regarded  as  an 
education.    The  focus  here  is  less 
attention  span  as  individual  traits 
characteristics  of  the  classroom, 
opportunities  provided  for  sustained 
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activity.    The  CPI  provides  an  indirect  measure  of  these 
constructs.     The  activity  continuity  code  designated  OLD 
ACTIVITY  marks  every  occasion  on  which  a  child  continues  an 
activity  from  one  twelve-second  interval  to  the  next.  By 
summing  durations  of  all  intervals  so  marked,  between  the 
outset  of  the  activity  (indicated  by  a  NEW  ACTIVITY  code) 
and  its  termination  (indicated  by  another  NEW  ACTIVITY  code 
or  a  NO  ACTIVITY  code)  it  is  possible  to  measure  the  total 
duration  of  every  activity  in  the  twenty-minute  observation 
period  to  the  nearest  twelve  seconds.     The  mean  duration  of 
each  child's  longest  activity  is  approximately  11  minutes. 
Phase  III  data,  consistent  with  Phase  li  findings  and 
previous  research,  show  that  activities  last  longer,  on  the 
average,  in  groups  of  older  children  than  in  younger  groups. 
Moreover,  activities  last  longer  in  groups  where  structured 
activities  predominate.    The  correlation  between  activity 
length  and  the  classroom  activity  balance  was  -.37  (p<.01) 
in  fall. and  -.48  {p<.01)   in  spring.     However,  LONGEST 
ACTIVITY  was  neither  strikingly  consistent  across  activity 
types  nor  stable  from  fall  to  spring. 

Patterns  of  Interaction 

The  interaction  variables  are  based  directly  on 
the  object  codes  of  the  CPI.     They  describe  the  distribution 
of  children's  attention  to  the  social  and  physical  environment 
at  a  relatively  coarse  level,  distinguishing  the  amount  of 
attention  directed  to  adults,  to  other  children,  to  groups 
of  children,  and  to  the  physical  environment. 

Orientation  to  Adults  was,  predictably,  twice 
as  frequent  in  caregiver-directed  activity  as  in  free  play. 
However,  frequencies  showed  fairly  high  correlations  across 
the  two  types  of  activity  period  {r=.43,  p<.01  in  fall, 
r=.36,  p<.01  in  spring),  indicating  that  some  groups  of 
children  were  consistently  more  adult-centered  than  others. 
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regardless  of  prevailing  activities.  The  construct  was  more 
stable  from  fall  to  spring  for  free  play  (r=,43,  p<,01)  than 
for  adult-directed  activity  periods  {r=.08,  n.s.) • 

Orientation  to  Individual  Children  also  showed  sub- 
stantial correlations  between  free  play  and  teacher-directed 
activities  {r=,60,  p<.01  in  fall;  r=,35,  p<,01  in  spring), 
again  indicating  a  consistent  focus  of  some  classrooms  on 
child-child  interchange.     Combined  frequencies  of  this  vari- 
able across  the  two  types  of  activity    period  were  moderately 
stable  from  fall  to  spring  {r=.29,  p<,01).     However,  the 
Atlanta  Public  Schools  subsample,  which  showed  a  particularly 
high  level  of  orientation  to  children  in  the  fall,  also 
showed  a  drop  from  fall  to  spring  which  was  not  observed 
in  any  of  the  49-center  study  sites. 

Orientation  to  Groups  was  included  as  a  dependent 
measure  primarily  to  determine  whether  children's  contact 
with  their  peers  affected  by  classroom  composition,  specifi- 
cally whether  their  attention  is  directed  to  group  rather 
than  solitary  or  one-to-one  activity  as  total  class  size 
grows.     Fall-to-spring  correlations  for  this  measure  were 
.38  {p<.01)   for  free  play  and  .27  {p<.01)   for  teacher- 
directed  activity.     Consistency  across  teach.er-directed  and 
free  play  activities  was  .24  {p<.05)   in  fall  and  .27  {p<.01) 
in  spring. 

Orientation  to  the  Environment  also  showed  consis- 
tency across  activity  types  (r  =  .45,  p<.01  in  fall;  r=.26, 
p<.01  in  spring).     However  the  variable  showed  only  modest 
stability  across  data  collection  periods.     (The  fall-spring 
correlation  for  the  combined  score  across  activity  periods 
was  .18,  p<.01).     In  addition,  there  were  noticeable  differ- 
ences across  sites  in  patterns  of  change  from  fall  to 
spring.     in  both  fall  and  spring  there  was  a  marginally 
significant  tendency  for  younger  children  to  show  more 


attention  to  the  enviro  went  and  less  to  adults  and  peers 
than  did  older  children  (p=.ll  in  fall,  p=.06  in  spring). 

Interest/Participation.    A  global  variable 
was  constructed  reflecting  the  degree  to  which  children  in  a 
class  are  actively  involved  in  its  social  and  educational 
activities.     INTEREST/PARTICIPATION  was  computed  as  the  sum 
of  many  codes  (GROUP  AND  INDIVIDUAL  OPEN,  EXPRESSIVE  ACTIVITY; 
CONSIDERS,  CONTEMPLATES  OR  TINKERS:  ADDS  PROP  OR  IDEA:  ACTS 
CREATIVELY  OR  SOLVES  PROBLEM:  OFFERS  TO  HELP  OR  SHARE; 
DEPENDS  RIGHTS:  MOVES  WITH  PURPOSE;  SELECTS  ACTIVITY  (alone 
or  with  others) ,  ASKS  FOR  INFORMATION;  ASKS  PERMISSION  TO 
SHARE;  GIVES  OPINIONS;  ASKS  FOR  RECOGNITION;  GIVES  ORDERS  OR 
DIRECTS  OTHERS;   INTRUDES  PLAYFULLY) .     The  construct  is 
related  to  a  behavior  cluster  that  has  emerged  repeatedly  in 
studies  of  preschool  children  in  group  care  settings  and 
that  is  associated  with  children's  later  social  adjustment 
and  cognitive  achievement.!    A  similar  construct  also  emerged 
during  Phase  li  of  the  NDCS.2    m  both  Phase  II  and  Phase 
III,  codes  comprising  the  construct  were  positively  corre- 
lated with  each  other  and  negatively  correlated  with  codes 
indicating  noninvolvement.     INTEREST/PARTICIPATION  also  was 
positively  related  to  task  persistence  (r=.22,  p<.05  in 
fall;  r=.26,  p<.01  in  spring).     NON-INVOLVEMENT  showed 
negative  correlations  in  the_^3^.4_x^nge  with  INTEREST/ 
PARTICIPATION  in  both  free  play  and  teacher-directed  activity 
periods.     Thus,  NON-INVOLVEMENT  and  INTEREST/PARTICIPATION 
together  tend  to  array  classrooms  along  a  general  dimension 
indicating  the  degree  to  which  children  are  integrated  into 
classroom  activities.     A  similar  bipolar  dimension  emerged 
in  the  studies  as  well  as  in  Phase  II  of  the  NDCS.  in 
spring,  high  levels  of  COOPERATION/COMPLIANCE  tended  to 
accompany  high  levels  of  INTEREST/PARTICIPATION  and  low 
levels  of  NON-INVOLVEMENT.     (No  significant  relations  were 
found  in  fall.)     m  short,  though  the  relevant  correlations 
were  not  strong,  INTEREST/PARTICIPATION  was  part  of  a  broad 
cluster  of  positive  dynamics  in  the  classroom. 
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Classroom  Activity  Balance 


A  variable  was  constructed  to  characterize  the 


global  dynamics  of  the  day  care  group  activities.     The  most 
commonly  used  CFI  codes  were  PARTICIPATES  IN  GROUP  ACTIVITY — 
CLOSED,  STRUCTURED  and  PARTICIPATES  IN  GROUP  ACTIVITY — OPEN- 
ENDED,  EXPRESSIVE.     These  two  codes  represented  about 
one-third  of  all  activities  recorded.    When  individual 
structured  and  open-ended  activities  are  pooled  with  the 
respective  group  activity  codes,  all  four  together  accounted 
for  over  37  percent  of  the  codes  recorded.     Class-level  cor- 
relations between  frequencies  of  structured  and  open-ended 
activities  were  negative  and  substantial  in  both  the  fall 
{r=-.36,  p<.01)  and  spring   (r=-.63,  p<.01),  indicating  that 
classrooms  tend  to  be  characterized  by  one  type  of  activity 
or  the  other. 


"closed,  structured"  are  not  necessarily  equated  with  edu- 
cational activities.     Rather,  the  codes  represent  activities 
that  have  a  clearcut  end  point  or  achievable  goal,  whereas 
open-ended  expressive  activities  do  not.     Either  type  of 
activity  can  be  educationally  or  developmentally  valuable. 
Nevertheless  the  two  types  of  activity  codes  seem  to  capture 
distinctive  classroom  styles. 

The  CLASSROOM  ACTIVITY  BALANCE,  designed  to  locate 
a  given  classroom  on  the  structured/open-ended  dimension,  is 
constructed  BY  subtracting  the  sum  of  frequencies  of  group  and 
individual  structured  activities  from  the  sum  of  frequencies 
of  group  and  individual  open-ended  activities.     This  differ- 
ence score  averaged  -.06  in  the  fall  and  -.04  in  the  spring, 
indicating  a  slight  prevalence  of  structured  over  open-ended 
activity,  and  very  little  change*  ^^ith  time  in  the  overall 
balance  among  Phase  III  centers-     Th^.  relative  ranking  of 
different  classrooms  on  the  unstructured/open-ended  dimen- 
sions was  moderately  stable  from  fall  to  spring  (r=.36. 


It  should  be  noted  that  activities  defined  as 
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P<.01).  Open-ended  activities  were  more  prevalent  in 
classes  with  younger  children. 


Activity  Transition 

Three  frequently  occurring  codes  seemed  to  involve, 
at  least  partially,  a  form  of  transition  from  one  activity 
to  another.     The  single  codes  for  MONITORING  ENVIRONMENT, 
^:OVES  WITH  PURPOSE,  and  GROUP  PASSIVE  ACTIVITY  were  considered 
independently  as  variables.     Each  of  these  codes  appeared  to 
suffer  from  multiple  meanings  requiring  a  more  elaborate 
description  of  the  context  than  was  possible  for  the  CFI. 
For  example,  group  passive  activity  included  waiting  in  line 
and  television  watching  as  well  as  storytime. 

MONITORS  ENVIRONMENT  was  consistent  across 
activity  types  (r=.61,  p<.oi  for  fall  and  r=.37,  p<.01  for 
spring)  but  was  only  moderately  stable  from  fall  to  spring 
(r=.07,  n.s.  for  free  play,  r=.21,  p<.01  for  adult  directed 
activity).     MOVES  WITH  PURPOSE  was  also  relatively  stable 
over  activity  types  (r=.40,  p<.01  for  fall  and  r=.22,  p<.01 
for  spring)  but .only  moderately  stable  over  data  collection 
periods  (r=.lo,  n.s.  for  free  play;  r=.28,  p<.01  for  adult 
directed  activity).     GROUP  PASSIVE  ACTIVITY  provided  little 
evidence  of  stability  across  either  activity  types  (r=.Ol, 
n.s.  for  fall  and  r=-.02,  n.s.  for  spring)  or  data  collection 
periods  (4=.05,  n.s.  for  free  play  and  r=-.01,  n.s.  for 
adult  directed  activity). 
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CHAPTER  FIVE;     SELECTION  OF  INDEPENDENT  MEASURES 


The  selection  of  independent  and  dependent  vari- 
ables was  motivated  by  a  decision  made  at  the  outset  of 
the  study  to  focus  attention  on  those  aspects  of  the  quality 
of  day  care  that  bear  directly  on  the  child.     In  effect, 
ACYF  (and  its  contractors)  took  the  position  that  the 
primary  goal  of  day  care  purchasing  standards  is  to  ensure 
the  best  possible  environment  for  the  most  children.  Other 
goals  of  day  care — e.g.,  freeing  parents  to  work,  serving  as 
a  vehicle  for  delivery  of  social  services  to  parents, 
employing  low-income  people  as  staff  and  fostering  their 
development  as  professionals — were  recognized  as  legitimate 
and  important  but  were  not  central  to  the  study. 

As  a  consequence,  in  selecting  regulatable  center 
characteristics  for  intensive  investigation  as  independent 
variables,  priority  was  given  to  those  deemed  most  likely  to 
effect  children's  daily  experiences,  namely  the  composition 
of  the  classroom  (principally  group  size  and  staff/child 
ratio)  and  the  qualifications  of  caregivers  (education  and 
experience).     Other  center  characteristics  (space,  equipment 
and  materials;  center  philosophy  and  curriculum;  director 
qualifications;  stability  of  caregiver/  child  relationships; 
availability  of  nutrition  and  health  services;  availability 
of  other  supplementary  services  and  specialists;  opportunities 
for  parent  involvement)  were  examined  in  descriptive  and 
exploratory  fashion  to  determine  whether  any  appeared  to 
have  major  effects  on  classroom  processes  and      lid  outcomes. 
However,  in  light  of  preliminary  results  which  ^^ggested 
that  most  of  these  variables  had  minimal  effects  on  the 
particular  outcome  measures  chosen,  only  a  few  of  the 
variables  were  investigated  further,  and  then  only  to  a 
limited  extent. 
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Two  types  of  independent  variables  were  tested  in 
the  effects  analyses:     background  variables,  such  as  age,  sex 
and  race  of  children  as  well  as  socioeconomic  characteristics 
of  families  and  of  the  community  served  by  the  particular 
center,  and  policy  variables,  i.e.,  center  characteristics 
subject  to  rrjulatory  control.    While  background  variables 
are  unregulatable  and  therefore  not  of  direct  policy  relevance 
their  effects  had  to  be  taken  into  account  in  assessing  the 
effects  of  the  policy  variables. 

Information  on  bar'    -  ^und  characteristics  of 
children  and  their  familie  ot^)o^ed  through  interviews 

with  parents.     Background  i.  tion  included  family 

income,  sources  of  income,  parents*  education  and  occupation, 
length  of  parents*  employment,  number  of  siblings  and  number 
of  adults  living  in  the  house.     Age,  sex  and  race  of  children 
were  verified.     In  addition,  census  data  were  used  to 
provide  background  information  on  demographic  characteristics 
of  the  community,  chiefly  its  socioeconomic  and  racial 
composition. 


A  set  of  variables  that  describe  the  socioeconomic 
characteristics  of  the  children's  families  was  aggregated 
from  the  child  level  to  the  class  level  as  potential  indepen- 
dent measures.     These  included  mean  family  income,  mean 
mother's  education,  mean  proportion  of  single  parents,  mean 
number  of  children  under  12  in  the  home,  and  mean  proportion 
of  black  children  in  the  class.     The  simple  correlations  of 
these  demographic  variables  with  the  dependent  measures  in- 
dicated few  significant  relationships,  more  often  associated 
with  the  fall  data  collection  than  with  the  spring.  Since 
the  five  demographic  variables  were  strongly  intercorrelated , 
(Table  5.1)   and  because  was  five  SES  covariables  was  a  large 
number  to  enter  into  the  regression  analyses  as  independent 
measures,  a  clustering  was  completed  to  represent  the 
average  socioeconomic  status  of  the  children  in  each  class. 
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Table  5.1 

INTERO^RELATION  OF  SCX:iOEC0NOMIC 
MEASUREb  IN  NDCS  CLASSROOMS 

Proportion   Number  of  Proporation 
Mother's        Family      of  Single     Children        of  Black 
Education      Income        Parents      Under  12  Childr«i 


Mother's 
Education 


.72 


.55 


-.43 


-.25 


Family  income 


.71 


-.66 


-.42 


-.43 


Proportion 
of  Single 
Parents 


-.51 


-.70 


.36 


•39 


Number  of 
Children 
Under  l'^ 


-.47 


-.39 


.35 


•31 


Proportion 
of  Black 
Children 


-.26 


-.41 


.38 


.32 


XX 


All  values  shown  are  p<,05;  values  above  the  diagonal  are  for  fall 
(N=117) ,  values  below  the  diagonal  are  for  spring  (N=116) . 
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The  five  variables  were  factor  analyzed  and  a  principal 
component  factor  score  was  assigned  to  each  class.  This 
principal  component  score  typically  fell  between  -1  and  1, 
with  positive  scores  indicating  higher  SES,  was  the  main  SES 
covariable  in  the  regression  equations.     In  addition, 
caregiver  race  was  used  as  a  covariable. 

The  third  covariable  that  was  entered  in  regression 
computations  was  child  age.    The  grouping  of  children  by  age 
is  a  well-established  practice  in  day  care  classrooms.  The 
1968  federal  regulations  require  slightly  more  staff  per 
child  and  smaller  numbers  of  children  in  groups  of  children 
three  years  of  age  as  opposed  to  groups  of  four-year  old 
children.     Thus,  if  age  where  not  controlled  statistically, 
there  might  be  a  tendency  for  the  less  mature  behavior'^'of 
three-year  old  children  to  be  associated  with  high  staff/ 
child  ratio  and  small  groups.    This  would  not,  however,  be 
an  accurate  indication  of  the  impact  of  group  composition 
upon  child  behavior.     Therefore,  in  all  regression  equations 
for  the  CPI  variables,  the  average  age  of  the  children  in 
the  group  was  included  as  a  covariable. 

The  major  policy  variables  examined  in  the  NDCS 
fell  into  two  categories— those  relating  to  classroom 
composition  and  those  relating  to  caregiver  qualifications. 
Three  classroom  composition  variables  were  considered: 


NUMBER  OP  CAREGIVERS,  defined  as  the  total 
number  of  caregivers  present  in  or  assigned  to 
a  classroom;  ' 
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•  GROUP  SIZE,  defined  as  the  total  number  of 
children  present  in  or  assigned  to  a  class  or 
to  a  principally  responsible  caregiver;*  and 

•  STAFF/CHILD  RATIO,  defined  as  the  number 
of  caregivers  divided  by  group  size. 

Caregiver  qualifications  variables  consisted  of  total  years 
of  formal  education  (YEARS  EDUCATION),  presence  or  absence 
of  childrelated  education/training  (SPECIALIZATION),  day  care 
experience — both  prior  to  current  job  (PREVIOUS  DAY  CARE 
EXPERIENCE),  and  time  in  current  center  (CENTER  EXPERIENCE). 

Information  on  caregiver  qualifications  was 
gathered  from  interviews  with  caregivers.  Information 
on  variables  related  to  classroom  composition  was  gathered 
by  two  methods,  one  based  on  schedule  or  roster  data  and  the 
other  on  direct  observation,  i.e.,  as  part  of  the  CFI, 
Schedule-based  and  observation-based  measures  of  classroom 
composition  were  not  always  in  close  agreement  (see  Bache, 
1980a).     Differences  between  the  two  were  primarily  attribu- 
table to  two  phenomena — absenteeism  and  merging  of  classes. 
Because  observations  capture  the  group  configurations  actu- 
ally experienced  by  the  child  and  because  they  automatically 
take  account  of  absenteeism  and  merging,  observation-based 


*In  all  but  a  few  NDCS  centers,  groups  of  children  were 
assigned  to  particular  rooms,  supervised  by  a  single 
caregiver  or  several  caregivers.     In  a  few  "open  classroom" 
centers,  however,  very  large  numbers  of  children  (approach- 
ing 100  in  extreme  cases)  were  present  in  a  single  large 
room.     Even  in  such  centers,  children  clustered  around 
individual  caregivers  or  small  teams  dispersed  around  the 
room,  though  children  were  often  free  to  move  from  group  to 
group.     Numbers  of  children  in  these  smaller  groups  consti- 
tuted the  group  size  used  for  NDCS  analytic  purposes. 
Similarly^  numbers  of  caregivers  reflected  the  number  of 
adults  in  physically  separated  groups. 


measures  were  used  in  all  the  analyses  reported  in  this 
paper.*    Table  ,5.2  shows  correlations  among  the  major  policy 
variables  across  the  Phase  III  classrooms.    The  table  indi- 
cates that  the  classroom  composition  variables  ara  essentially 
uncorrelated  with  the  caregiver  qualifications  variables,  so 
thnt  their  effects  can  be  easily  separated,    within  the 
Cluster  of  qualifications  variables,  modest  correlations 
exist— high  enough  to  warrant  caution  in  interpreting  indivi- 
dual effects  but  not  high  enough  to  preclude  identification 
of  the  most  powerful  variable(s).    A  similar  correlation 
Qxists  between  GROUP  SIZE  and  STAFF/CHILD  RATIO  for  the 
spring  observations. 

Table  5.3  shows  relationships  among  the  policy 
variables  and  the  set  of  background  variables  describing  the 
children,  families  and  communities  served  by  the  ndCS  centers. 
Again,  most  correlations  are  small,  indicating  that  effects 
of  policy  -variables  can  be  separated  from  those  of  particular 
background  factors.     Some  moderate  correlations  do  exist, 
however.     Perhaps  most  important  are  the  associations  of 
staff/child  ratio  and  staff  qualifications  in  current  centers 
with  various  indices  of  socioeconomic  status:     high  ratios 
and  experienced  staff  with  some  child-related  education/training 
are  found  in  centers  serving  low-SES  families.    This  pattern 
of  associations  is  tied  to  federal  funding.  Low-income 
children  are  served  in  federally  funded  centers,  which  are 
subject  to  higher  fIDCR  ratio  and  training  requirements  and 

*Three  distinct  sets  of  observation  data  were  collected 
One  set  was  collected'on  a  regular  basis  by  NDCS  staff 
employed  full  time  at  each  center  during  Phases  if'^nd  III; 
this  set  was  used  in  analyses  of  non-behavioral  data.  A 
aroEse^vJt^nnfnf''^  was  made  in  conjunction  with  behavior- 
!i^h  «K  °^  caregivers,  and  a  third  in  conjunction 

with  observations  of  children;  these  counts  were  used  in 

iationr"P°^''^"^-^^^^^^°"'  analyses.  Behavto^afobser- 
vations  are  described  below  and  in  later  chapters. 
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Table  5.2 

CORRELATIONS  AMONG  THE  MAJOR  POLICY  VARIABLES 


Classroom  ..•.•osUion 


Staff/  Years 
Group    Child  of 
Size     Ratio  Education 


Child- 
Related 
Education/ 
Training 


Previous 
Day  Care 
Experience 


Experience 
in  Current 
Center 


Group  Si2f 
Staff/ChiUi  Mlo 


-30 


-.23 


Staff  Qual 


Years  ol'  /iducf,  io*. 
Child-Reuv .  •  -A-dCQ- 

tion/Trai-ring 
Previous  D^y  Care 

Experience 
Experience  in 

Current  Center 


.36 


.20 


.28 


.28 


All  values  shown  are  p<.05;  values  above  the  diagonal  are  for  fall  (N=U7);  values 
below  the  diagonal  are  for  spring  (N=116). 
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Table  5.3 

CORRELATIONS  AMONG  POLICY  AND  BACKGROUND  VARIABLES 


Classroom  Composition 


Fall,  1976    fN=117)         Spring,  1977  (N«116) 


SES  of 
Family 


Age  of 
Children 


SES  of 
Family 


Age  of 
Children 


Group  Size 
Staff/Child  Ratio 


-.27 


.21 
-.24 


-.2: 


•  22 
-.20 


Staff  Qualifications 


Years  of  Education 

Child-Related  Educa- 
tion/Training -.28 

Previous  Day  Care 
Experience 

E:iperience  in  Current 
Center 


All  values  shown  are  p^.05. 
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which  pay  slightly  higher  wages  and  have  lower  staff  turnover 
rates  than  do  parent-fee  centers.    This  pattern  of  relation- 
ships reaffirms  the  point  that  background  factors,  such  as 
socioeconomic  status,  must  be  controlled  when  exploring 
relationships  between  policy  variables  and  various  measures 
of  children's  development. 


CHAP'ER  SIX;     RESULTS  OF  CFI  ANALYSES 


The  CFI  analyses  are  reported  in  four  groups. 
7irsfr.,  the  effects  of  staff/child  ratio  were  tested  in  a 
qua?. -experiment  with  a  three-group  ANOVA  design.  The 
results  for  the  quasi-experiment  suggested  that  the  manipu- 
lation of  ratio  did  not  result  in  systematically  different 
child  activities  or  behavior.     Second,  regression  analyses 
were  performed  for  the  commonly  used  codes  and  combinations. 
Third,  rare  but  important  behaviors  were  analyzed  by  logit 
techniques.     Finally,  regression  analysis  was  used  to 
investigate  the  behavior  of  children  in  a  structured 
situation . 


The  variables  examined  in  these  analyses  are 
combinations  of  codes  that  utilize  virtually  all  of  the 
coded  child  behavior.    The  CFI  gathered  a  broad  range  of 
information  relevant  to  many  different  behaviors  of  children. 
Day-to-day  behaviors  were  observed  in  considerable  detail. 
The  resulting  measures  should  not  be  used  directly  or 
individually  to  form  judgements  about  individuals  or  the 
dynamics  of  different  classrooms.     Rather,  it  is  important 
to  identify  patterns  of  child  activity  that,  taken  as  a 
whole,  could  reasonably  be  judged  as  beneficial  to  children. 

There  are  three  reasons  for  this  approach. 
First,  the  reliabilities  of  individual  codes  and  measures, 
while  acceptable  for  analytic  purposes,  are  not  high  enough 

o  support  the  use  of  a  single  measure.     Second,  there  are 
numerou-.  significant  intercorrelations  among  the  observation 
m'  tsures,  indicating  that  the  measures  are  not  independent. 
Third,  the  CFI  measures  do  not  represent  behaviors  that 
have  a  positi  .'e  or  negative  meaning  independent  of  the 
relative  level  of  the  behavior  in  the  entire  data  set. 
While  an  "optimal"  level  for  each  behavior  may  exist,  that 
value  has  not  yet  been  determined.    An  example  of  this  is 
the  amount  of  time  that  children  are  uninvolved  in  meaningful 
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activity.    A  preschool  environment  where  children  were 
continuously  involved  in  some  activity  with  no  time  during 
the  day  to  be  by  themselves  might  be  regarded  as  an  over- 
stimulating  or  over-regimented  day  care  group-  Nevertheless, 
a  relatively  high  level  of  inactivity  may  be  seen  as  an 
essentially  negative  index  when  it  is  related  to  independent 
measures  in  similar  ways  as  frequent  wandering,  low  levels 
of  verbal  initiative  and/or  cooperation - 

Experimental  Study  of  Rati  Effects 

As  described  earlier,  the  effects  of  staff/child 
ratio  were  tested  in  a  quasi-experiment  in  49  of  the  centers. 
The  question  tested  was  whether  children  in  high-ratio 
classrooms  with  an  experimentally  induced  increase  in  ratio 
behaved  differently  when  compared  with  children  in  either 
untreated  low-ratio  or  untreated  high-ratio  classrooms-  In 
a  series  of  one-way  analyses  of  variance  comparing  child 
behavior  in  these  three  types  of  situations,  there  were  few 
detectable  effects  of  ratio-    A  significant  result  {p<.05) 
occurred  in  only  two  cases.    During  adult-directed  activities, 
children  in  the  high*  ratio  groups  wandered  less  and  exhibited 
more  task  persistence-     Since  two  significant  results  from 
the  30  analyses  conducted  could  have  occurred  by 
chance,  little  confidence  can  be  placed  in  these  results  as 
impacts  of  the  NDCS  manipulation. 

Similarly,  in  the  APS  experiment,  few  significant 
effects  could  be  found  for  the  manipulated  variables  (STAFF/ 
CHILD  RATIO  and  LEVEL  OF  EDUCATION).     Children  in  high  ratio 
APS  classrooms  cooperated  more  readily  during  both  free  play 
and  adult-directed  activities,  and  oriented  to  adults  more 
frequently  during  free  play-     Children  in  groups  with  a  high 

*Staff/child  ratio,  defined  as  the  number  of  caregivers 
divided  by  group  size  is  higher  in  situations  where  rela- 
tively more  adults  are  present- 
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level  of  education  appeared  to  cooperate  more  readily  during 
adult-directed  activities.  Although  these  results  suggest  a 
mildly  positive  impact  for  the  research  variables,  there  is 
not  sufficient  strength  nor  consistency  in  these  outcomes  to 
conclude  that  the  NDCS  manipulations  had  a  major  effect  upon 
the  activities  and  behavior  of  children. 

Regression  Analysis 

The  CFI  regression  model  included  six  policy 
variables  and  two  covariables.    The  six  policy  variables 
were  observed  GROUP  SIZE,  observed  STAFF/CHILD  RATIO, 
caregiver  YEARS  OF  EDUCATION,  education  in  a  child-related 
field  (SPECIALIZATION),  experience  in  day  care  prior  to 
employment  at  current  center  (PREVIOUS  EXPERIENCE),  and 
experience  in  current  center  (CENTER  EXPERIENCE).  All 
measures,  dependent  and  independent,  were  averaged  to  the 
classroom  level.     Thus,  the  measures  of  caregiver  qualifica- 
tions represent  averages  for  the  staff  in  the  classroom. 
The  two  covariables  entered  were  average  age  of  children  in 
the  class  (CLASS  AGE)  and  a  class-level  measure  of  socio- 
economic status  (FAMILY  SES). 

For  the  regression  analysis  of  CFI  data,  both 
standard  regression  and  biweighted  regression  equations  were 
produced.     Biweighted  regressions  were  used  because  ordinary 
least  square  estimators  are  neither  robust  nor  resistant 
where  data  are  not  normally  distributed  (Hosteller  and 
Tukey,  1977).     Resistance  concerns  the  sensitivity  of 
Obtained  estimates  to  extreme  values  of  a  small  number  of 
sample  observations.     Robustness  refers  to  the  relative 
stability  in  the  population  from  which  the  sample  is  drawn. 
In  cases  like  the  NDCS,  where  class  level  regression  models 
are  estimated  on  sample  and  subsamples  ranging  in  size  from 
28  to  117,  the  relative  nonresistance  and  nonrobustness  of 
ordinary  least  squares  may  be  problematic.     Outlier  values 
may  suppress  or  elevate  effects  which  are  not  applicable  for 
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the  entire  sample.*    Biweighting  is  one  way  to  approach  the 
problem  of  estimation  under  such  conditions. 

Summary  and  Discussion  of  Regression  Analyses. 
A  summary  of  the  significant  regression  results  (Table  6.1) 
suggests  a  meaningful  profile  of  child  activity  and  behavior 
that  is  related  to  both  the  day  care  year  and  key  NDCS 
policy  measures.    A  discussion  of  the  analysis  of  each 
individual  measure  follows  this  review  of  the  overall 
results  for  covariables  and  policy  measures. 

Covariables.     In  the  fall^  both  CHILD  AGE  and 
FAMIIiY  SES  frequently  related  to  the  behavior  of  preschool 
children  in  day  care  groups.     Older  children  offered  more 
opinions^  were  more  cooperative,  and  were  oriented  towards 
other  children  more  frequently  than  were  younger  children. 
Transitional  activity  in  older  day  care  groups  was  more 
often  associated  with  movement  than  with  environmental 
monitoring.     By  spring,  several  of  the  fall  trends  had  been 
softened.     Age  trends  for  VERBAL  INITIATIVE,  COOPERATION  and 
TRANSITIONAL  ACTIVITY  were  no  longer  significant.  Age 
differences  in  PATTERNS  OF  INTERACTION  persisted  (older 
children  spent  relatively  more  time  oriented  to  other 
children  and  groups  and  less  time  oriented  to  adults). 
Perhaps  in  preparation  for  entry  into  school  there  was  a 
tendency  for  more  formal,  structured  activity  in  groups  of 
older  children  by  springtime. 

♦Outliers  may  take  many  forms;   they  may  be  deviations  from 
the  regression  surface,  extreme  values  of  the  observed 
values  relative  to  the  rest  of  the  sample,  or  both.  Bi- 
weighted  regression  essentially  attempts  to  deal  with 
deviations  from  the  regression  surface  that  are  large. 
Other  "outliers"  may  "unduly"  influence  the  regression  fit 
without  necessarily  being  extreme  deviations  from  the 
fitted  surface.     Such  observations  are  said  to  have  high 
"leverage,"  and  another  set  of  diagnostic  tools  is  required 
for  examining  data  with  potential  problems  from  a  few  obser- 
vations with  high  leverage  (see  Hoaglin  and  Welsch,  1978). 
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Similarly,  differences  related  to  FAMILY  SES 
were  weaker  in  the  spring  than  in  the  fall,  suggesting  a 
homogenizing  effect  of  the  group  care  experience.  During 
the  fall  observations,  children  from  higher  SES  families 
were  somewhat  less  cooperative,  less  involved  and  less 
persisten'w  at  activities,  but  they  engaged  more  often  in 
reflection/innovation.    Those  same  children  were  also  found 
more  often  in  open,  unstructured  activities  and  passive 
group  activities.     Several  of  these  trends  persisted  in  the 
spring  data  base.     Higher  SES  children  continued  to  partici- 
pate relatively  more  often  in  unstructured  activities  where 
involvement  and  persistence  at  a  task  were  less.  However, 
fall  observation  differences  concerning  REFLECTION/INNO- 
VATION, COOPERATION  and  TRANSITIONAL  ACTIVITY  did  noc 
reappear  in  the  spring.    This  pattern  suggests  that  NDCS 
centers  serving  relatively  higher  SES  children  were  less 
structured  in  their  approach  to  activities  and  perhaps  took 
a  longer  time  to  organize  the  children  into  functioning 
groups  while  leaving  time  for  individual  activities  and 
thought  during  the  period  when  many  children  were  entering 
or  re-entering  the  center  on  a  full-time  basis. 

Group  Composition,     Relationships  of  child  behavior 
to  the  size  of  the  day  care  group  were  strong  and  consistent 
during  both  fall  and  spring  observation  periods  and  were 
frequently  significant  both  in  simple  correlations  and  in 
regression  equations.     The  strength  of  the  relationship  olf 
group  size  to  child  activity  was  persistent  across  both  free 
play  and  teacher-directed  activities  and  across  the  day  care 
vear.     Examination  of  biweighted  regression  results  hiJ  .  .ites 
that  outlier  groups  did  not  greatly  influence  the  GRO'-P  fcl^E 
result  and  actually  strengthened  those  results  in  the  ' 
observation  data  base. 

In  both  fall  and  spring,  children  in  smaller 
groups  offered  opinions  more  frequently  and  engaged  in  more 
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reflection/innovation.     Small  groups  of  children  also  were 
more  often  oriented  to  adults  and  less  often  to  groups  of 
children  than  large  groups.     In  addition  to  relationships 
that  were  persistent  over  the  day  care  year,  several  other 
types  of  child  behavior  were  related  to  group  size  in  the 
spring  but  not  in  the  fall,  suggesting  the  emergence  of  some 
relatively  undesirable  trends  in  large  groups,     in  the 
spring  data  base,  large  groups  of  children  cooperated  less 
readily  and  had  more  activity  involvement  and  less  wan<^*  ring. 
Also,  large  groups  remained  in  activities  longer  and, 
perhaps  a  related  result,  were  found  more  often  in  passive 
activities. 


In  contrast,  STAFF/CHILD  RATIO  was  infrequently 
related  to  child  behavior  during  either  data  collection. 
However,  higher  ratios  were  associated  with  less  wandering 
and  with  greater  task  persistence  both  in  the  fall  and  in 
the  spring,     in  addition,  higher  ratios  were  associated  with 
more  unstructured  activities  and  more  transitional  activity 
(environmental  monitoring  during  free  play;  moving  with 
purpose  during  adult-directed  activity)  during  the  fall. 
Although  high  ratios  appear  to  have  less  pervasive  effects 
than  small  groups,  the  observed  relationships  suggest  a 
moderately  positive  influence  for  higher  ratios. 

Caregiver  Qualifications.     None  of  the  caregiver 
qualifications  had  especially  powerful  or  pervasive  effects. 
However,  classrooms  with  a  relatively  high  proportion  of  staff 
having  child-related  preparation  (SPECIALIZATION)  were  marked 
by  higher  child  involvement  and  greater  task  persistence  at 
both  data  collection  points.     Also,  several  desirable 
relationships  appeared  in  the  spring  data  base,  suggesting  a 
cumulatively  positive  impact  of  SPECIALIZATION.  These 
relationships  include  more  reflection/innovation,  more 
cooperation,  and  more  interest/participation  in  groups  with 
more  specialized  staff. 
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Classes  with  highly  educated  caregivers  also  were 
iTiarked  by  relatively  high  frequencies  of  REFLECTION/INNOVATION 
on  the  part  of  children  (both  fall  and  spring),  but  also  by 
low  frequencies  of  COOPERATION  (fall  and  spring)  and  less 
TASK  PERSISTANCE  (spring  only).     However,  several  of  the 
relationships  between  staff  education  and  child  behavior  may 
be  due  to  statistical  artifacts.     Of  all  the  NDCS  independent 
variables,  YEARS  OF  EDUCATION  was  most  frequently  affected  by 
the  biweighting  procedures,  and  significant  results  were 
frequently  eliminated  or  softened  in  the  biweighted  regres- 
sions for  both  fall  and  spring  (6  of  14  significant  results 
appeared  to  be  considerably  weaker  in  the  biweighted  regres- 
sions than  in  the  ordinary  regression  computations). 
Apparently  significant  regression  results  may  also  be  due  to 
multicollinearily  or  to  legitimate  interactions  among  the 
predictor  variables.     Thus,  it  is  difficult  to  draw  conclu- 
sions concerning  the  relationship  of  caregiver  education  to 
child. behavior  in  the  NDCS. 

The  two  experience  variables  are  rarely  related  to 
child  behavior.  Further,  no  relationships  persist  from  fall 
to  spring  or  across  APS  and  49-center  samples. 

Discussion  of  Regression  Model 

Detailed  discussion  of  the  CFI  findings  is  concen- 
trated on  data  collected  in  spring  1977  for  the  entire  NDCS 
sample  of  day  care  classrooms.    Not  only  did  spring  data 
collection  procedures  minimize  observer  effects,  but  the 
data  themselves  were  likely  to  reflect  patterns  of  child 
behavior  that  have  stabilized  over  the  year.     The  discussion 
of  regression  results  includes  consideration  of  consistency 
between  the  fall  and  spring  data  analyses  and  between  the  49 
center  and  APS  samples  of  classrooms.     Results  of  the 
relevant  standard  and  biweighted  regressions  ate  shown 
for  each  of  the  dependent  variables  separately  for  free  play 
activities  and  adult-directed  activities      (see  Tables  6.2 
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to  6.16)     Individual  coefficients  for  the  covariables  are 
not  reported  in  the  regression  tables  since  there  was  no 
evidence  of  interaction  between  the  covariables  and  the 
policy  variables.     However,  significant  relationships 
are  reported  in  the  text  and  the  contribution  of  the  covari-  , 
ables  to  the  total  R    is  indicated  in  the  tables. 

Reflection/Innovation  (Table  6.2).     In  both 
observation  contexts— free  play  and  adult-directed  activity- 
more  REFLECTION/INNOVATION  on  the  part  of  children  was 
associated  with  smaller  groups.    This  relationship  was 
particularly  strong  in  the  APS  sample  (r  =  -.54,  p<.oi  for 
free  play;  r  =  -.50,  p<.01  during  adult-directed  period)  Y  it 
similar  trends  were  also  found  in  the  49-center  sample. 
Also,  a  significant  relationship  indicating  more  REFLECTION/ 
INNOVATION  in  small  groups  was  found  in  the  fall  data  base 
during  adult-directed  activities  but  not  during  free  play. 

More  YEARS  OF  EDUCATION  for  caregivers  was  associated 
with  more  REFLECTION/INNOVATION  for  children  during  free 
play  (at  both  fall  and  spring  data  collection  points).  This 
result  is  found  primarily  in  the  49-center  sample.  During 
adult-directed  periods,  a  similar  relationship  exists  for 
specialized  caregiver  education/training,  but  only  in  the 
spring.     At  that  time,  more  SPECIALIZATION  is  related 
to  more  REFLECTION/INNOVATION  in  both  the  APS  (r  =  .55, 
P<.01)  and  the  49-center  sample  (r  =  .21,  p<.05).  Finally, 
more  CAREGIVER  EXPERIENCE  is  related  to  more  child  REFLECTION/ 
INNOVATION  during  free  play  in  the  spring. 

Verbal  Initiative  (Table  C.3).     During  the  fall 
observations,  older  children  offered  more  opinions  than 
younger  children  for  both  free  play  and  adult-directed 
activities.     This  result  was  found  in  both  49-center  and  APS 
samples  at  that  time,     no  relationship  between  age  of 
children  and  frequency  of  verbal  initiative  was  found  in  the 
spring  data  collection. 
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Table  6.2 

RESULTS  OP  RKRESSIQtlS  OF  CHILD  BMOR  VARIABLES  ON  SELECTED  POLICY  VARIABLES 
Dependent  Variable;  Reflection/Innovation 
Spring  1977  (N  =  116) 

DURING  FREE  PtAY  ACTIVITIES 


Policy  Variables 

Least  Squares  Coefficient 
Biweighted  Ordinary 

t 

Signifi- 
cance 
oft 

Simple 
Correla- 
tion 

R^  for  Policy 
Variables  (R^ 
with  Covariables) 

Observfid  arfiUD  qi7p 

-,\jW  -.004 

1,75 

.08 

-.25** 

.13 

Observed  staff/child  ratio 

.007  .013 

0.14 

.90 

.11 

(.13) 

Child-related  education^ 
training 

-.003  -.009 

0.89 

.38 

Staff  education 

.001^  .005 

1.62 

.11 

.13 

Previous  day  care 
experience 

.003  .004 

1.28 

.20 

Experience  in  current 
day  care  center 

.004  ,004 

.2.44 

.02 

,20* 

DURING  ADULT-DIRECTED  ACTIVITIES 

Observed  group  size 

-.001  -.001 

1.71 

.09 

-.19* 

.08 

Observed  staff/child  ratio 

.045  .014 

0.12 

.90 

.12 

(.11) 

Child-related  educatior;/ 
training 

.014  ,018 

1.91 

.06 

,28** 

Staff  education 

.000  .002 

0.49 

.63 

.12 

Previous  day  care 
experience 

.002  .001 

0.30 

.76 

.10 

Experience  in  current 
day  care  center 

.001  .001 

0.56 

.  .58 

.14 

*p<.05 
**p<.01 

^     ^indicates  change  greater  than  1/2  standard  error  of  least  squares  coefficient  in  biweighted  regression. 
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glligS^    OF  Oiii,  BMQR  mm.  ^  SELEM  PQLICV  vapt^.pc 

Dependent  Variable;  Verhai  Tn^n'an'.-;:  ^  

Spring  ID'/'i  (iJ  =  n'gf  

DURING  FREE  PIAY  ACTIVITIES 

Observed  group  size 
Observed  staff/child  ratio 

Child-related  education/ 
training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 


Observed  group  size 
Observed  staff/child  ratio 

Child-related  education/ 
training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 

*p<.05 
**p<.01 


-.001 

-.001 

2.12 

.04 

-.21* 

.11 

.049 

.109 

1.40 

.17 

.15 

(.16) 

•UUj 

.006 

0.62 

.54 

.24* 

.003 

.004 

1.43 

.16 

.24* 

-.UU4 

-.003 

l.Cl 

.32 

.01 

,-.002 

-.002 

1.40 

.16 

-.10 

DURING  ADULT-OIRBCTED  ACTIVITIES 

-.001 

-.001 

1.87 

.06 

-.19* 

.08 

.067 

.047 

0.55 

.58 

.08 

(.11) 

,003 

.003 

0.30 

.76 

-.01 

.004 

.003 

1.06 

.29 

.19* 

-.002 

-.004 

1.22 

.22 

-.04 

-.001 

-.002 

1.40 

.16 

-.15 
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At  both  data  collection  points  and  for  both  free 


play  and  adult  related  activities,  children  offered  more 
opinions  when  in  small  groups.     This  trend  was  consistent, 
though  not  always  significant,  in  both  the  APS  and  the 
49-center  groups. 

YEARS  OF  EDUCATION  was  related  to  VERBAL  INITIATIVE 
in  the  fall  observations  only.     At  that  time,  children  in 
classrooms  with  more  education  expressed  opinions  more  often. 
This  relationship  was  found  primarily  in  the  APS  sample 
(r  =  .44,  p<.05  for  free  play,  and  r  =  .52,  p<.01  for  adult- 
directed  activity) . 


tions,  COOPERATION  was  related  to  the  covariables  during 
both  free  play  and  adult-directed  activities.     Older  children 
were  more  cooperative  during  adult-directed  activities  and 
children  from  low  SES  families  were  slightly  more  cooperative 
during  free  play.     These  relationship's  did  not  recur  in  the 
spring  observations. 


to  cooperation  in  the  fall,  children  in  smaller  groups 
cooperated  relatively  more  often  in  the  spring  regardless  of 
the  activity.     This  trend  was  found  in  both^  the  APS  and 
49-center  samples. 


activities  was  related  to  caregiver  SPECIALIZATION.  More 
cooperation  was  associated  with  higher  proportions  of  care- 
givers with  specialized  education/training.     YEARS  OF  EDU- 
CATION was  a  significant  regressor  for  free  play  activities, 
in  both  the  fall  and  spring,  but,  since  the  simple  correla- 
tion of  EDUCATION  and  COOPERATION  was  essentially  zero, 
this  apparent  effect  is  probably  due  either  to  mul ticolline- 
arity  or  to  interactions  among  the  policy  variables.  The 


Cooperation  (Table  6.4).     During  the  fall  observa- 


While  no  group  composition  measures  were  related 


In  the  spring,  COOPERATION  during  free  play 
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Table  6.4 


RESULTS  OF  RESRESSIOIS  OF  ffllU)  BETOR  mmp,     cPrrr^en  nnf^  mmr 

Dependent  variapie;  Cooperation  ~  

Spring  1977  (N  =  116) 


Least  Squares  Coefficieni: 
ffeVariables  Biiijhti  iSy 

Observed  group  size  -.007^  ..006 

Observed  staff/child  ratio  -.038 


DURING  FREE  PIAY  ACTIVITIES 

Signifi-  simple  R^  for  folicy 

cance  Correl^-    variables  (R^ 

-J  of  t  .    tion_  with  Covariables) 

2.44  .01 


Child-related  education 
training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 


Observed  group  size 

Observed  staff/child  ratio 

Child-related  education/ 
training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 

•  *p<.05 
**p<.01 

a.. 


.112 


-.097 
.137 


0.26 
2.97 


.79 

.00 


-.24** 
.08 
.22* 


.11 

(.13) 


-.013^ 

-.026 

1.97 

.05 

-  08 

.001 

-.004 

0.24 

.81 

.07 

-.010 

-.009 

1.17 

.24 

.04 

DURING  ADULT-DIRECTED  ACTIVITIES 

-.005 

-.005 

1.87 

.06 

-.21* 

.06 

.141 

.147 

0.46 

.65 

.13 

(.07) 

.036 

.042 

1.18 

.24 

.11 

-.012 

-.003 

0.30 

.76 

.07 

-.006 

.003 

0.28 

.78 

.10 

-.007 

-.003 

0.47 

.64 

-.02 

indicates  chaises  greater  than  1/2  starriard  error  of  least  squares  coefficient  in  biweight^ 


regression. 
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fact  that  this  result  was  true  for  the  49-center  sample  but 
not  the  APS  also  supports  the  nonsignif icance  of  an  education 
effect.     None  of  the  other  caregiver  qualifications  was 
associated  with  COOPERATION  during  adult-directed  activities, 

Non-Involvement  (Table  6,5)  ,     Higher  SES  groups 
tended  to  have  more  non-involvement  in  both  activity  contexts 
and  at  both  data  points.     In  the  spring,  child  NON-INVOLVEMENT 
during  free  play  activities  was  significantly  related  to 
GROUP  SIZE:     non- involvement  tended  to  be  more  frequent  in 
larger  classrooms.     In  the  context  of  adult-directed  activi- 
ties, child  NON-INVOLVEMENT  was  not  related  to  GROUP  SIZE, 
However,  there  was  more  NON-INVOLVEMENT  in  lower  ratio 
classrooms , 


The  level  of  non-invvolvement  in  a  classroom  was 
negatively  related  to  caregiver  education/training  in  a 
child-related  area.     That  is,  there  tended  to  be  more 
activity  in  classrooms  where  more  Ccregivers  had  specialized 
preparation.     This  result  held  for  all  activity  types  in 
both  APS  and  49-center  samples  in  the  fall,  but  was  evident 
for  free  play  activities  in  the  spring  data  collection. 

Aimless  Wandering   (Table  6,6),     The  frequency  of 
children  aimlessly  wandering  in  the  classroom  was  related 
both  to  GROUP  SIZE  and  to  STAFF/CHILD  RATIO  in  the  spring 
observations.     Wandering  children  were  more  frequently 
observed  in  larger  classrooms  and  in  classrooms  with  lower 
staff/child  ratios.     This  pattern  existed  for  both  free  play 
and  adult-directed  activities,  although  the  GROUP  SIZE 
effect  for  AIMLESS  WANDERING  was  substantially  weaker  during 
the  adult-directed  activities. 


Task  Persistence  (Table  6,7).     Children  from  lower 
SES  families  remained  in  a  single  task  longer  during  free 
play  activities  in  the  fall  and  during  both  activty  types 
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Table  6.5 


Spring  1977  (N  =  116]  


DURING  FREE  PUy  ACTIVITIES 
l^ast  Squares  Coefficient  ^"f^'     "  Policy-, 

Observed  group  size  003  '  ~  "'^  t^variablesl 

^served  staff/Child  ratio  .'057  "l" 

Child-related  aJucation/  -  022^  .  ^'^^^ 

training  '"^^  "'O^S        3.32     .00  -.34** 

Staff  education  nno 

0   .    .  '^^^  1-34     .18  03 

Previous  day  care  nnc 

^        exDeriJ  "'^^^  -'006        1.42  .16 


experience  ^-42     .16  -.26** 

Experience  in  current 
day  care  center 


Observed  group  size 

Observed  staff/child  ratio     ,073^        .'150        ^'Z  '^^ 

(hilc^related  aJucatio^      ,019  nn  1  ^'^^^ 

training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 

*p<.05 
**p<.01 

^  'i^icates  c^e.  greater  than  va  sta^ard  error  of  least  s^res  coefficient  in  U.^  regression. 
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.000 

.001 

0.68 

.50 

-.13 

DURING  ADULT-DIRBCTED  ACTIVITIES 

.001 

.001 

0.87 

.39 

.17 

-.073^ 

-.150 

1.59 

.11 

-.26** 

-.019 

-.012 

1.18 

.24 

-.21* 

.001 

-.001 

0.42 

.67 

-.05 

.006 

.002 

0.66 

.51 

-.03 

.001 

.000 

0.10 

.99 

.01 

H 

0\ 


Table  6.6 

RESULTS  OF  REGRESSIONS  OF  CHIU)  BEHAVIOR  VARIABLES  ON  SELECTED  POLICY  VARIABLES 
"      Dependent  Variable:  Wandering 
Spring  1977  (N  =  116) 

DURING  FREE  PIAY  ACTIVITES 


Policy  Variables 

Least  Squares  Coefficient 
Biweighted  Ordinary 

f 
I 

Signifi- 
cance 

01  L 

Simple 
Correla- 
Lion 

2 

R  for  Policy 
Variables  (R^^ 
witn  Covariables) 

Observed  group  size 

.002 

.002 

2.17 

.03 

.33** 

.17 

uuscLvcu  oLaii/cnuQ  racio 

-.231 

-.229 

1     A  A 

1.82 

.07 

-.30** 

(.17) 

Child-related  educatioiV 
training 

-.004 

-.003 

0.25 

.80 

Staff  education 

-.004 

-.004 

1.01 

,32 

-.16 

Previous  day  care 
experience 

-.006 

-.006 

1.21 

.23 

-.20* 

Experience  in  current 
day  care  center 

-.001 

-.001 

0.34 

.73 

-.06 

DURING  ADULT-DIRECTED  ACTIVITIES 

Observed  arouo  sItp 

.002 

.002 

1,51 

.13 

.21* 

.16 

Observed  staff/child  ratio 

-.274 

-.294 

2.77 

.01 

-.31** 

(.17) 

Child-related  education/ 
training 

-.003 

-.007 

0.18 

.86 

-.14 

Staff  education 

-.008 

-.006 

1.45 

.15 

-.16 

Previous  day  care 
experience 

-.006 

-.006 

1.31 

.20 

-.20* 

Experience  in  current 

-.001 

-.001 

0,42 

.68 

-.06 

day  care  center 


*p<.05 
**p<.01 
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Table  6.7  ' 

iffiigent  Variable;  TasK  PerRigt-ftnpa    —  — 

spring  1977  (NMief 


DURING  FREE  PUY  ACTIVITIES 


H 
nI 
si 


Policy  Variables 

Observed  group  size 

Observed  staff/child  ratio 

Child-related  educatiorv' 
training 

Staff  edxation 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 

Observed  group  size 

Observed  staff/child  ratio 

Child-related  education 
training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 

*p<.05 
**p<.01 


Least  Squares  Coefficipnf- 
-^^weighted  ordinary 

_J  

Signifi- 
cance 

_  oft 

Simple 
Correla- 
tion 

-.004 

-.005 

0.34 

.73 

-.06 

.285 

.323 

1.94 

.06 

.25** 

.054 

.058 

2.82 

.01 

.31** 

-.012 

-.016 

2.69 

.01 

-.15 

.014 

1.97 

.05 

.25** 

.001 

.001 

0.15 

.88 

.17 

DURING  ADULT-DIRECTED  ACTIVITIES 

.003 

.005 

1.62 

.11 

.10 

.311 

.298 

2.09 

.04 

.19* 

.091 

.093 

2.22 

.03 

.21* 

-.010 

-.012 

1.86 

.07 

-.09 

.002 

.002 

0.12 

.91 

.06 

.002 

.002 

0.22 

.83 

.09 

.2 


2 


with  Covariables) 
.13 
(.20) 


.08 
(.13) 
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in  the  spring.     Also,  for  adult-directed  activities  in  the 
fall  and  for  both  activity  types  in  the  spring,  children 
remained  involved  in  tasks  longer  when  staff/child  ratio  was 
higher,     A  trend  toward  longer  activities  in. larger  groups 
was  found  for  adult-directed  activities. 

The  strongest  relationship  to  TASK  PERSISTENCE  was 
found  with  SPECIALIZATION.     Children  remained  in  activities 
longer  where  more  staff  had  specialized  preparation  This 
relationship  was  evident  both  during  free  play  and  adult- 
directed  activities  and  at  the  two  data  collection  points. 
For  free  play  activities  in  the  spring,  groups  where  staff 
had  more  experience  in  other  day  care  centers  exhibited  more 
task  persistence.     YEARS  OF  EDUCATION  was  a  significant  re- 
gressor  in  the  spring   (for  both  free  play  and  adult-directed 
activities)   but  was  not  strongly  correlated  with  TASK 
PERSISTENCE;   thus,  as  with  COOPERATION,   this  apparent 
relationship  is  probably  due  to  multicollinear ity  or  to 
legitimate  interactions. 

Interest/Participation   (Table  6.8).     Few  relation- 
ships between  the  policy  variables  and  the  INTEREST/PARTICI- 
PATION construct  were  discovered  in  the  Phase  ill  data  base. 
In  the  fall,  larger  groups  were  associated  with  the  lower 
participation.     The  only  relationship  found  in  the  spring, 
however,  was  a  weak  tendency  for  more  specialized  staff  to 
have  groups  with  a  greater  level  of  interest/participation. 

Classroom  Activity  Balance  (Table  6.9).  The 
dominant  relationships  round  for  the  structural  balance  of 
activities  in  the  classroom  were  for  the  covariables. 
Younger  children  and  cnildren  from  higher  SES  families 
participated  more  oftei  in  open,  unstructured  activities 
both  in  fall  and  spring.     In  addition,  the  incidence  of 


Table  6.8 


RESULTS  OF  RKRESSm  OP  CHIU  BEMR  mmm  m  cPr^^n  pQLicy  VARIABLES 

Dependent  yariabie!  InterestyParticipS  

spring  1977  (N  =  U6) 


DURING  FREE  Mi  ACTIVITIES 

tion    with  Covariables) 


Mialidables         ffigg  eSt^  j^Tt 

Observed  group  size 
Observed  staff/child  ratio 

Child-related  educatior^ 
training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 

*p<.05 
**p<.01 


-.002 

-.003 

1.20 

.28 

-.15 

.242 

.285 

0.92 

.35 

.17 

.054 

.053 

1.28 

.12 

-.14 

-.003 

-.004 

.25 

.70 

-.15 

.002 

.002 

.02 

.90 

-.19 

-.004 

-.004 

.78 

.47 

-.07 

.06 

(. 
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Table  6.9 


RESULTS  OF  REGRESSIONS  OF  CHILD  BEHAVIOR  VARIABLES  ON  SELECTED  POLICy  VARIABLES 
Dependent  Variable:  Classroom  Activity  Balance 
Spring,  1977  (N  =  116) 


ALL  ACTIVITIES  COMBINED 

Ordinary  Least         signif-  Simple     R^  for  Policy- 
Squares             icance  Correla-    Variables  (R 
Policy  Variables           Coefficient  t      oft  tion    with  Covariables) 

Observed  group  size         ,003   .003  1.36     ,21  .13  .03 

Observed  staff/child  ratio  ,100   .140  0.35     ,68  .08  (.21) 

Child-related  education/ 

training                -.035  -.031  0,83     ,41  -.21 

Staff  education            -.020  -.026  0,29     ,82  -.03 

Previous  day  care 

experience              -,004  -,004  0,31     ,78  -,10 

Experience  in  current 

day  care  center           ,005  ,006  0,93     .35  -,07 


*p<.05 
**p<.01 


ERIC 


Table  6.10 


RESULTS  OF  REGRESSIONS  OF  CHIU)  BEHAVIOR  VARIABLES  ON  SELECTED  POLICY  VARIABLES 
Dependent  Variable;  Orientation  to  Adults  ~ 
Spring  1977  (N  =  116) 

DURING  FREE  PLAY  ACTIVITIES 

Signifi-  Simple     R^  for  Policy, 
Least  Squares  Coefficient  cance     Correla-    Variables  (R^ 

Policy  Variables  Biweighted       Ordinary      t      oft      tion     with  Covariables) 

Observed  group  size  -.008         -.006        3.11     .00      -.30**  .11 

Observed  staff/child  ratio 

Child-related  education/ 
training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
SJ      day  care  center 


to 


.159 

.231 

0.84 

.40 

1  AX 

.18* 

(.15) 

.015 

.028 

0.80 

.43 

-.01 

-.011 

-.009 

0.94 

.35 

-.05 

-.002 

-.004 

0.31 

.76 

.07 

-.007 

-.009 

1.41 

.16 

-.18* 

DURING  ADULT-DIRECTED  /.aWITIES 

-.007 

-.007 

2.78 

.01 

-.27** 

.11 

-.120 

-.105 

0.32 

.75 

.08 

(.14) 

.026 

.026 

0.74 

.46 

.02 

Observed  group  size 

Observed  staff/child  ratio 

Child-related  educatior\/ 
training 

Staff  education  -.021         -.000        0.02     .96  .09 

Previous  day  care  .008  .009        0.78     .44  .13 

experience 

Experience  in  current         -.002         -,002        0,34     .74  -.07 
day  care  center 

*p<.05 
**p<.01 


Table  6.11 


H 
00 
CO 


MSOLIS  OF  ™s    PHtrn  —  ..,,r  ON  SELECTS  PQLICV  mn.. 

Dependent  yariable;  Orientation  to  chTE —  

spring  iy77  (N  =  116)  

DURING  FREE  PIAY  ACTIVITIES 

« group  sirs  .002  .002        u7     .25    ~  Z  

tetved  staff/Child  ratio     -.m         -.078        o.«     .68      -.09  ("oe) 
Child-relatd  ed  W      ,003         ,004        0.I6     .87  .05 


Staff  education 

.006 

.006 

0.96 

.34 

.09 

Previous  day  care 
experience 

-.001 

-.001 

0.08 

.93 

-.03 

Experience  in  current 
day  care  center 

.002 

.002 

0.54 

.59 

.04 

DURING  ADULT-DIRBCTED  ACTIVITIES 

Observed  group  size 

.003 

.003 

1.33 

.19 

.10 

Observed  staff/child  ratio 

.101 

.121 

0.47 

.64 

-.01 

Child-related  education/ 
training 

-.002 

-.002 

0,07 

.94 

.15 

Staff  education 

.013 

.016 

1.99 

.05 

.28** 

Previous  day  care 
experience 

-.000 

-.000 

0.02 

.99 

.02 

Experience  in  current 
day  care  center 

.001 

.001 

0.17 

.86 

.03 

*p<.05 
**p<.01 
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.08 

(.18) 
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Table  6.12 


RESULTS  OF  REGRESSIONS  OF  CHILD  BEHAVIOR  VARIABLES  CM  SELECTED  POLICY  VARIABLES 
Dependent  Variable;  Orientation  to  Groups 
Spring,  1977  (n  =  116) 


DURING  FREE  PIAY  ACTIVITIES 


H 
00 


,2 


Policy  Variables 
Observed  group  size 


Least  Squares  Coefficient 
Biweighted  Ordinary 

.003  .003 


2 


2.86 


Signifi-  Simple  R  for  Policy, 

cance  Correl*-  Variables  (R' 

of  t      tion  with  Covariables) 

.00       .28**  .11 


Observed  staff/child  r;5hin 

.10  J 

.172 

1.58 

.12 

.14  (.16) 

Child-related  educatior^/ 

trainina 

.008 

.008 

0.54 

.59 

.05 

staff  education 

-.003 

0.90 

.37 

-.12 

Previous  day  care 
exDerience 

.000 

.000 

0.04 

.97 

-.01 

txperience  in  current 
day  care  center 

-.005 

-.004 

1.40 

.16 

-.09 

DURIN3  ADULT-DIRECTED  ACTIVITIES 

Observed  group  size 

.005 

.004 

2.43 

.02 

.29**  .12 

Observed  staf^/child  ratio 

-.010 

-.017 

0.20 

.84 

-.04  (.14) 

Child-rel::;ed  education/ 
training 

.012 

.012 

0.68 

.53 

.01 

Staff  education 

-.005 

-.006 

1.25 

.21 

-.14 

Previous  day  care 
experience 

.003 

-.004 

0.54 

.59 

-.07 

Experience  in  current 

-.009 

-.008 

2.07 

.03 

-.16 

day  care  center 


*p<.05 
**p<.01 


ERIC 
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Table  6.13  "  •  ' 


RESULIS  OF  mmmj  r^rrn  p..,..  ^  „  ^^^^^^^^^^ 

Depenaent  variable:  urientation  to  EnvlmS^  — 

Spring  1977  (N  =  n6)   

DURING  FREE  PIAY  ACTIVITIES 

Observed  group  size 

Observed  staff/child  ratio 

Child-related  education 
training 

Staff  education 

Previous  day  care 
H  experience 

00 

w      Experience  in  current 
day  care  center 


-.003 

-.003 

1.72 

.22 

-.20* 

.06 

.040 

.036 

0.79 

.44 

-  nn 

•uu 

/  f\C\ 

(.06) 

.003 

.002 

0.49 

.62 

.06 

f  WW 

.004 

.003 

0.70 

.48 

.10 

-.022 

t  Vfcb 

1.60 

.11 

-.16 

.000 

.000 

0.06 

.94 

.02 

DURING  ADULT-DIRECTED 

ACTIVITIES 

-.002 

-.002 

0.83 

.41 

-.05 

.04 

-.050 

-.045 

0.15 

.89 

-.01 

(.04) 

.010 

.002 

0.07 

.95 

0.04 

.002 

-.003 

0.32 

.76 

-.05 

-.010^ 

-.022 

1.64 

.10 

-.16 

.001 

-.000 

0.06 

.96 

.02 

Observed  group  size 

Observed  staff/child  ratio 

Child-related  education 
training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 

*p<.05 
**p<.01 

'indicates  changes  of  greater  than  1/2  sta^ard  error  of  least  squares  coefficient  in  biweighted 


regression. 


Table  6.14 

RESULTS  OF  REGRESSIONS  OF  CHIU)  BEHAVIOR  VARIABLES  ON  SELECTED  POLICY  VARIABLES 
Dependent  Variable;  Monitors  Environment 
Spring  1977  (N  =  116) 


DURING  FREE  PLAY  ACTIVITIES 


Policy  Variables 

Observed  group  size 

Observed  staff/child  ratio 

Child-related  education/ 
training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 


-.002 

-.oor^ 

.001 


-.002 
-.001 

.001 


,2 


Signifi-  Simple     R^  for  Policy, 


Biweighted 

Ordinary 

t 

of  t 

.001 

.001 

1.51 

.14 

.018 

.022 

0.25 

.82 

-.012 

-.011 

0.83 

.41 

2 


tion     with  Covariables) 


.14 
-.06 
-.13 

0.57  .58  -.09 
0.18     ,86  -.08 

0.25     .73  -.03* 


.04 
(.06) 


DURING  ADULT-DIRECTED  ACTIVITIES 


Observed  group  size 

.002 

.002 

1.87 

.06 

.24* 

.09 

Observed  staff/child  ratio 

-.090 

-.117 

0.88 

.38 

-.15 

(.09) 

Child-related  education/ 
training 

.015 

.019 

1.34 

.19 

,  .06 

Staff  education 

-.004 

-.005 

1.29 

.21 

-.10 

Previous  day  care 
experience 

.004 

.004 

0.87 

.39 

.04. 

Experience  in  current 
day  care  center 

-.000 

-.001 

0.15 

.83 

-.03 

*p<.05 
**p<.01 
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Table  6.15 

RESULIS  OF  TOSSIONS  OF  CHII^  BEHAVIOR  mmn.  r.^c^^^^ 

J^pringOT  (N  =  H6)  ^ 

DURING  FREE  PLAY  ACTIVITIES 

^^il^  t  ^^^^^ 

,30  •„  ; 

Child-related  education/        .006  m         .  r.  ^ 

training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 


.030 

.078 

0.54 

.50 

.05 

.006 

.008 

0.59 

.48 

.18 

.002 

.003 

1.45 

.14 

.16 

-.002 

-.002 

-.93 

.36 

-.05 

-.001 

-.001 

0.51 

.46 

-.02 

IXJRIN3  ADULT-DIRECTED 

ACTIVITIES 

.000 

.000 

0.45 

.65 

.02 

-.029 

.056 

1.14 

.26 

.12 

-.002 

.004 

0.60 

.47 

.11 

.002^ 

.003 

1.75 

.08 

.22* 

.001 

.001 

0.16 

.88 

.06 

-.000 

-.000 

0.54 

.64 

-.09 

Observed  group  size 

Cbserv^^  staff/Child  ratio     -,29  ,56         U4     ,6       ,2  /  ' 

Child-related  education/       -.002  nn^  n 

training 

Staff  education 

Previous  day  care 
experience 

Experience  in  current 
day  care  center 

*p<.05 
**p<.01 

^i^iicates  Changes  of  greater      1/2  sta^ard  error  of  least  squares  coefficient  in  biweight«i  r^ression. 


Table  6.16 

RESULTS  OF  REGRESSIONS  OF  CHILD  BEHAVIOR  VARIABLES  ON  SELECTED  POLICY  VARIABLES 
Dependent  Variable;  Group  Passive  Activity 
spring  1977  {N  =  116) 


DURINS  FREE  PUY  ACTIVITIES 


Policy  Variables 

Least  Squares  Coefficient 
Biweighted  Ordinary 

t 

Signifi- 
oft 

Simple 

wllcJ.Ci- 

tion 

2 

R  for  Policy. 
variaDies  (h 
with  Covariables) 

Observed  group  size 

.002 

.002 

1.37 

.15 

.25** 

.15 

Observed  staff/child  ratio 

-.029 

-.032 

0.66 

.51 

-.06 

(.18) 

Child-related  education/ 
training 

-.020 

-.024 

1.28 

.20 

-.15 

Staff  education 

.006' 

.005 

1.36 

-.18 

-.19* 

Previous  day  care 
experience 

.003 

.003 

0.83 

.42 

.08 

Experience  in  current 

-.002 

-.002 

2.08 

.04 

-.30** 

day  care  center 

*p<.05 
**p<.01 
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Determinants  of  Rare  but  Important  Events 


Some  of  the  CFI  codes  that  occurred  infrequently 
(e.g.,  only  a  few  times  per  thousand  frames  of  observation) 
might  be  viewed  as  having  unusual  psychological  importance 
or  as  being  unusually  revealing  regarding  the  behavioral 
climate  of  a  day  care  center.     Relevant  codes,  termed 
"critical  incidents-  are  listed  in  Table  6.17,  along  with 
their  frequencies  of  occurrence  in  Fall  1976  and  Spring 
1977.     Because  of  their  rarity  and  because  a  code  that  was 
recorded  once  tended  to  recur  over  several  frames,  these 
events  exhibited  extremely  skewed  distributions  across 
classrooms,  with  many  classes  showing  no  occurrences  of  a 
given  behavior  and  other  classes  showing  small  flurries  of 
critical  events,  e.g.,  a  brief  hostile  exchange  between 
children,  followed  by  a  few  minutes  of  crying. 

Ordinary  regression  analysis  embodies  distribu- 
tional assumptions  that  are  violated  by  rare  events  of  this 
kind.     However,  logit  analysis,  an  alternative  form  of 
regression,  is  designed  to  handle  such  events,     m  essence, 
logit  analysis  estimates  the  odds  of  a  rare  event  occurring 
at  all  in  a  given  classroom,  characterized  by  a  given 
configuration  of  policy  variables.     (In  contrast,  ordinary 
regression  as  it  has  been  used  elsewhere  predicts  the  fre- 
aiiincj.  of  a  given  event  as  a  function  of  policy  variables.) 

A  series  of  logit  analyses  was  conducted,  using 
as  dependent  variables  the  eighteen  rare  codes  listed  in 
Table  6.17.     The  independent  variables,  which  were  similar 
to  those  used  in  the  regression  analysis,   included  STAFF/ 
CHILD  RATIO,  GROUP  SIZE,  YEARS  OF  EDUCATION,  PREVIOUS 
EXPERIENCE,  CENTER  EXPERIENCE,  and  two  covar iables-CHILD 
AGE  and  STAFF  AGE.     Analyses  were  conducted  separately  for 
fall  and  spring,  as  well  as  for  the  Altanta  Public  Schools 
and  each  of  the  49-center  sites.    Thus,  for  each  pairing  of 
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Table  6,17 


FREQUENCIES  OF  CRITICAL  INCIDENTS  CODES 
AS  PERCENTAGE  OF  ALL  CODES 


Fall  1976  Spring  1977 


Offers  sympathy 

0.1 

0.0 

Shares,  helps 

0.6 

0.6 

Receives  praise 

0.4 

0.3 

Asks  for  comfort 

0.1 

0.0 

Receives  comfort 

0.3 

0.3 

Crying 

0.2 

0.2 

Avoids,  withdraws 

0.1 

0.1 

Isolates  self 

0.7 

0.1 

Hostile  exchange 

0.1 

0.1 

Intrudes  hostilely 

0.2 

0.1 

Receives  hostile  intrusion 

0.1 

0.1 

Receives  rejection 

0.1 

0.1 

Refuses  to  comply 

0.3 

0.2 

Hostilely  asserts  rights 

0. 1 

0.1 

Temper  tantrum 

0.0 

0.1 

Receives  threats 

0.4 

0.3 

Receives  physical  punishment 

0.0 

0.0 

Experiences  accident 

0.1 

0.0 

216 
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an  independent  variable  with  a  dependent  variable  (108  such 
pairs  in  all)  there  were  eight  separate  opportunities  for  a 
positive  or  negative  relationship  to  appear  (four  sets  of 
centers  at  two  different  time  points). 

Given  this  situation,  it  is  not  surprising  that 
the  pattern  of  outcomes  is  exceedinqly  complex.  Relatively 
few  relationships  achieve  conventional  levels  of  statistical 
siqnificance  taken  in  isolation.     However,  the  primary 
concern-was  not  with  relationships  occurring  in  a  particular 
place  at  a  particular  time  but  with  broader  relationships 
that  were  fundamentally  invariant  across  places  and  times. 
To  identify  such  relationships  the  followinq  criteria  for 
declarina  the  existence  of  "consistent-  effects  were  adoDted 

(1)  The  signs  of  coefficients  were  consistently 
positive  (or  negative)   in  all,  or  in  all  but 
one,  of  the  possible  cases,  and 

(2)  Either  the  inconsistent  coefficient  was  not 
siqnificant  at  the  .05  level 

(3)  Or  at  least  one  of  the  consistent  coeffi- 
cients was  significant  at  the  .05  level. 

Table  6.18  summarizes  the  results  of  .applying 
these  criteria  to  the  array  of  data  qenerated  by  the  mul- 
tiDle  loqit  analyses.    The  table  is  in  the  form  of  a  matrix 
of  dependent  variables  (rare  codes)  crossed  by  independent 
variables  (policy  variables  and  covar iables) .    Wherever  a 
"+"  sign  appears  in  a  cell  at  the  intersection  of  a  partic- 
ular dependent  or  independent  variable,  it  indicates  that 
a  consistent  positive  association  was  found  using  the  defini- 
tion above.     A  "--  sign,  analogously,  indicates  a  consistent 
negative  relationship.     An  asterisk  in  a  cell  indicates  that 
at  least  one  coefficient  was  significant  at  the  .05  level. 
(For  technical  reasons,  loqit  analyses  were  not  possible  in 
all  eight  cases  for  every  variable,     m  some  cases,  events 
occurred  at  least  once  in  every  classroom  or  in  a  particular 


Table  6.18 


Relationships  Between  Policy  Variables 
and  Critical  Incidents^ 


Child 
Age 

S/C 
Ratio 

IGroup 
Size  1 

Staff IStaff  1 
Educ . 1 Exper  i 

Staff 1 
Age  1 

N  1 

1  Offers  sympathy 

1 

1 

8  1 

1  Shares,  helps 

0  1 

1  Receives  praise 

+ 

+ 

1     +  i 

+  1 

+  1 

3  1 

1  Asks  for  comfort 

- 

1 

1 

8  1 

1  Receives  comfort 

+ 

-  1 

1 

4  1 

1  Crying 

-  1 

1 

8  1 

1  Avoids,  withdraws 

+  * 

+  1 

1 

7  1 

1  Attends  self 

+ 

1 

1 

7  1 

1  Hostile  exchange 

+  *  1 

1 

8  1 

1   Intrudes  hostilely 

+ 

+  1 

1 

6  1 

1  Receives  hostile 
1  intrusion 

+  1 

~*  1 

8  1 

1  Receives  rej ec tion i 

+*  1 

8  1 

1  Refuses  to  comply  | 

+ 

+     1  1 

6  1 

1  Hostilely  asserts  I 
1       rights  | 

7  1 

1  Temper  tantrum  | 

7  1 

1  Receives  threats  I 

+ 

+  1 

4  1 

1  Receives  physical  I 
1       punishment  i 

+  *  1 

6  1 

1  Experiences  i 
1       accidents  | 

8  1 

£1 

Cell  entries — "  +  "  of  signs — indicate  directions  of  consis- 
tent relationships. 

♦Indicates  significance  at  the  .05  level  in  at  least  one  case. 
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sample.    Numbers  listed  in  the  right-hand  column  (N)  of 
Table  6.18  indicate  the  number  of  analyses  on  which  each 
consistency  judgment  is  based. 


Though  this  method  of  assessing  consistency  is 
approximate  at  best,  the  results  are  revealing.  Large 
groups  are  associated  with  indices  of  conflict  (HOSTILE 
EXCHANGE,   INTRUDES  HOSTILELY,  RECEIVES  THREATS,  RECEIVES 
PHYSICAL  PUNISHMENT,  RECEIVES  HOSTILE  INTRUSION)    and  of 
withdrawal   (ATTENDS  SELF).     m  only  one  case  (RECEIVES 
PRAISE)  are  large  groups  associated  with  a  critical  event 
that  would  generally  be  regarded  as  positive.     High  STAFF/ 
CHILD  RATIOS  are  associated  with  two  categories  of  experience 
that  might  be  regarded  as  beneficial  to  children  (RECEIVES 
COMFORT,  RECEIVES  PRAISE),  but  also  with  other  categories 
that  might  be  seen  as  negative  (RECEIVES  THREATS,  AVOIDS, 
WITHDRAWS  and  REFUSES  TO  COMPLY) .     High  levels  of  STAFF 
EDUCATION  are  associated  with  low  likelihood  of  CONFLICT  and 
REJECTION  and  high  likelihood  of  PRAISE,  but  also  high 
likelihood  of  AVOIDANCE/WITHDRAWAL  and  REFUSAL  TO  COMPLY. 
Once  again,  small  groups  are  associated  with  a  pattern  of 
outcomes  that,  in  our  view,  is  more  consistently  desirable 
than  the  patterns  associal.ed  with  any  other  policy  variables. 
In  contrast,  high  staff/child  ratios  seem  to  be  associated 
with  a  general  intensification  of  emotional  relationships, 
i.e.,  with  relatively  extreme  expressions  of  both  warmth  and 
anger.     The  highly  educated  caregiver  appears  to  have  a 
distinctive  style,  marked  by  avoidance  of  conflict.  However, 
because  the  critical  incident  analysis  was  pursued  indepen- 
dently of  other  portions  of  the  analyses,  no  attempt  was 
made  to  separate  effects  of  education  from  these  of  special- 
ization in  a  child-related  field. 

Child  Behavior  in  Structured  Situations 

It  has  been  shown  that  some  behaviors  of  psycho- 
logical interest  occur  infrequently  in  natural  settings  be- 
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cause  of  a  simple  lack  of  opportunity  for  children  to  act 
in  ways  that  meet  the  definitions  of  relevant  observation 
codes.     Historically  this  has  been  one  major  reason  why  so 
much  developmental  research  takes  place  in  contrived  labo- 
ratory settings.     The  legitimate  intent  of  this  kind  of 
research  has  been  to  achieve  maximum  control  over  relevant 
variables,  i.e.,  standardization  of  situations  to  which  all 
subjects  are  exposed,  and  exclusion  of  extraneous  influ- 
ences of  various  kinds.     To  achieve  such  control,  ecolog- 
ical validity  has  often  been  sacrificed. 


settings  reflects  both  the  enduring  characteristics  of  the 
individuals  involved  and  the  opportunities  and  incentives 
provided  by  the  situation.     Thus,  for  example,  when  an  angry 
child  is  observed,  it  is  difficult  to  determine  without 
additional  information  whether  the  child  is  characteristic- 
ally belligerent  or  whether  his/her  anger  is  due  to  some 
frustration,  threat  or  infringement  of  rights.     For  NDCS 
purposes,  measurement  of  situational  pressures  was  more 
important  than  measurement  of  child  traits.  Nevertheless, 
the  character  traits  of  children  might  change  as  a  conse- 
quence of  different  types  of  care,  and  this  trait  measurement 
was  of  interest  as  well  (even  though  only  short-term  change 
could  potentially  be  studied  during  the  NDCS). 


themselves — stimulating  or  boring,  threatening  or  reassuring — 
are  part  of  the  day  care  process  and  may  also  be  affected  by 
such  classroom  characteristics  as  staff/child  ratio,  group 
size  and  staff  qualifications.     Since  those  characteristics 
of  classrooms  vary  systematically  in  the  NDCS,  the  opportunity 
for  observation  of  behavior  associated  with  child  traits  may 
vary  as  well.     During  Phase  II  of  the  NDCS,  several  important 
child  bahaviors  occurred  infrequently  in  the  course  of 
naturalistic  observation.     Consequently,  an  effort  was  made 
to  enhance  Phase  III  observation  data  by  using  contrived  play 


The  behavior  of  children  and  adults  in  natural 


The  kinds  of  situations  in  which  children  find 
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situations  designed  to  highlight 
toward  peers  and  play  materials. 


selected  child  behaviors 


In  both  Pall  1976  and  Spring  1977  same-sex, 
same-age  pairs  of  children  were  placed  in  two  structured 
situations,  intended  to  present  clear  opportunities  for 
certain  types  of  behavior  that  were  relatively  rare  in 
natural  settings  and  that — if  influenced  by  the  policy 
variables — would  represent  important  domains  of  effects. 
The  situations  provide  the  opportunity,  but  not  necessity, 
for  voluntary  cooperation  and  sharing,  and  for  creative  and 
cooperative  use  of  materials.    The  two  structured  situations 
were  arranged  as  follows: 

•  In  the  limited  resources  situation,  the 
children  were  given  a  Play-Doh  game  with 
one  Play-Doh  mold  but  an  abundant  quantity 
of  Play-Doh.     The  crux  of  the  situation  was 
that  only  one  child  could  use  the  mold. 

•  In  the  abundant  resources  situation,  the 
children  were  given  a  Fisher-Price  Play 
Family  Village  and  associated  materials. 
This  toy  permits  independent  play,  cooper- 
ative play,  and  mutual  fantasy  play. 

In  both  cases,  behavior  was  recorded  using  the 
standard  CFI.     The  structured  situations  achieved  their  goal 
of  altering  the  frequencies  of  certain  important  forms  of 
behavior  (see  Table  6.19).     For  example,  frequencies  of 
open-ended,  cooperative  play,  innovative  use  of  materials 
and  reflective  behavior  all  increased  dramatically. 

Upon  examination,  the  patterns  of  intercorrelat ions 
for  frequently  used  codes  were  found  to  be  similar  for  the 
two  structured  observation  segments  during  both  data  collec- 
tion periods.     Correlations  for  codes  from  one  segment  to 
the  other,  and  correlations  for  codes  from  one  data  collec- 
tion period  to  the  other,  are  shown  in  Table  6.20.    The  pattern 
across  segments  is  one  of  strong  relationship  with  three 
exceptions:     CONSIDERS,  CONTEMPLATES  PROBLEMS,  SEES  PATTERN, 
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Table  6.19 


FREQUENCIES  OF  STRUCTURED  OBSERVATION  CODES^ 
(Fall,  1976  and  Spring,  1977  Combined) 


Structured 

Observation 

Classroom 

Limited 

1  Abundant 

Observations 

Resources 

1  Resources 

A. 

Activity  Codes 

Shares  open,  expressive 

12.8 

26.0 

1  30.1 

activity 

Monitors  environment 

10.5 

24.3 

1  5.8 

Offers  opinions 

7.8  1 

7.6 

1  10.5 

Receives  general  com- 

2.8  1 

4.2 

1  5.1 

iiicriii.o   ^jLLuni  ocner 

child) 

Receives  demands. 

0.6  1 

2.8 

1  1.7 
1 

requests  (from 

other  ch i Id ) 

Receives  information 

0.2  1 

1.9 

1  1.3 

1 

(from  other  child) 

Adds  prop  or  idea 

2.7  ! 

10.7 

1  27.1 

Considers,  contem- 

1.6 ! 

2.1 

1  7.9 

plates  problem 

Gives  orders,  directs 

1.0  ! 

2.2 

1  1.9 

others  (child) 

Receives  request  to 

0.1  1 

2.9 

1  0.7 

share  (from  other 

child) 

Sees  pattern,  solves 

0.1  1 

0.4 

1  1.2 

problem  | 

B. 

Object  Codes 

Attention  to  child  | 

23.0  1 

49.1* 

1  31.7 

Attention  to  environment! 

41.9  1 

44.7 

1  66.4 

C. 

Activity  Continuity  1 

Codes 

Not  involved  in  activity! 

7.3  1 

21.9 

1  0.2 

Tabled  codes  are  those  which  exceed  one  percent  frequency  for 
either  limited  or  abundant  resource  segments.    Code  frequencies 
are  shown  as  a  percentage  of  all  observation  codes.     For  both 
behavior  and  object  codes,  the  total  number  recorded  was  ap- 
proximately 725', 000   (classroom  observations),  40,000  (limited 
resources),  and  70,000  (abundant  resources). 
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Table  6.20 


STABILITY  OF  STRUCTURED  OBSERVATION  CODES 


CODE  DESCRIPTION 


I  Open,  unstructured  activity 
iMonitors  environment 
IVerbal  initiative 
iReceives  general  comments 
I  Receives  demands,  requests 
iReceives  information 
lAdds  prop  or  idea 
IConsiders,  contemplates  problem 
ISees  pattern,  solves  problem 
iGives  orders,  directs  others 
IReceives  request  to  share 
Attention  to  Child 
[Attention  to  Environment 
iNot  involved  in  activity 


Note:   all  correlations  shown  are  p  <  ,15;  T3:  n  =  117' 
T4:  n  =  116;  T3  to  T4:  n  =  111. 


L'URRELATION  BETWEEN 

1 1    CORRELATION  BETWEEN*" 

LIMITED  RESOURCES 

II  FALL, 

1976  AND 

AND  ABUNDANT 

1       SPRING,  1977 

RESOURCES 

IDATA  COLLECTION  PERIODS 

LIMITED 

1  ABUNDANT 

1  SEGMENTS 

RESOURCES 

1  RESOURCES 

1  Fall  1976 

1 Sprinq  1977 

.14 

.13 

1 

1  .38 

1  .64 

.39 

i  •  .43 

1      .51  ■ 

.34 

.39 

1  .75 

1  .55 

.12  1 

1  .36 

1  .39 

.12 

1  .36 

1  .39 

1  .43 

1  .68 

1  .32 

1  .55 

1  .11 

1      .11  1 

1  .18 

1      .15  1 

.22 '■  1 

1  .51 

1      .61  1 

.17  1 

1  .14 

1      .31  ,1 

.33  1 

1  .33 

1      .60  1 

.19  1 

.33  1 

1  .37 

1      .60  1 

.13  1 

ERIC 
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SOLVES  PROBLEM,  NOT  INVOLVED  IN  ACTIVITY,  Significant 
stability  across  data  collection  periods  was  also  evident. 

Eight  structured  observation  measures  (all  but  one 
combined  across  limited  and  abundant  resource  segments)  were 
entered  into  regression  analyses  with  a  set  of  predictors 
identical  to  that  used  in  the  classroom  observation  analyses. 
Two  covariables  (CHILD  AGE,  FAMILY  SES)   and  six  independent 
variables   (GROUP  SIZE,  STAFF/CHILD  RATIO,  SPECIALIZATION, 
YEARS  OF  EDUCATION,  PREVIOUS  DAY  CARE  EXPERIENCE  and  EXPERI- 
ENCE) were  entered,  and  the  APS  and  49-center  samples  were 
analyzed  separately.     The  second  covariable  (SES)  was  not 
used  for  the  APS  sample  since  since  that  sample  was  economic- 
ally and  racially  homogeneous. 

The  regression  results  are  summarized  in  Table  6.21. 
Two  points  relating  to  these  analyses  are  worthy  of  comment. 
First,  the  covariables  were  somewhat  stronger  predictors  of 
child  behavior  in  the  structured  observations  than  were  the 
NDCS  policy  variables.     The  relative  strength  of  CHILD  AGE 
as  a  predictor  was  weaker  in  the  spring  than  in  the  fall,  as 
was  the  case  in  the  classroom  observations.     FAMILY  SES  is  a 
relatively  stronger  predictor  in  the  spring  data.     No  consistant 
or  clearly  powerful  relationships  were  observed  between 
structured  situation  behavior  and  the  NDCS  policy  variables. 

Second,  replication  of  effects  were  extremely 
rare.     For  both  fall  and  spring,  older  children  exhibited 
more  verbal  initiative  and  engaged  in  less  environmental 
monitoring  than  younger  children,  and  children  from  higher 
SES  families  offered  more  opinions  than  those  from  lower  SES 
families.     Only  two  relationships  were  replicated  across  APS 
and  49-center  samples:     in  the  fall,  children  from  groups 
where  staff  had  more  experience  in  other  day  care  centers 
made  more  requests;   in  the  spring,  children  from  small  groups 
spent  more  time  considering  materials/solving  problems. 


198 


Table  6.21 


Sl^ary  of  significant  ^tmt.r,^  situation  He^r^sslnn  p^.m^c 

.S!S;  S;:.;;?  r  «^^^«^^^o^«^"ectlon/Orle.a. 
Fall  Obsemtion  Period  Khdivid       i                 n^^^^^  ^^^^^^^  Innovation  tion  to 
 0  \mmmi  Plajl    «   jive^  rjj^         JlWe^  la;^  Child 

Age  of  Ctiildrei)      I  i        .    .    !   . .   '        I  I  I 

SeS  of  Faolly 

Group  Composition 
Group  size 
Staff/Child  Ratio 


Caregiver  Qyallficationj 
Specialization 
years  of  Education 
Previous  Day  Care 

Experience 
Experience  in  current 
Center 


\o  Sprii 


Observation  Period 


Covariables 
Age  of  Children 
SES  of  Family 

Group  Composition 
Group  size 
Staff/Child  Ratio 


(+1 


Caregiver  Qoallficationfi 
Specialization 
Hears  of  Education 
Previous  Day  Care 

Experience 
Experience  in  Current 

Center 

W's  noted  ^re  ,l,„lf,c,„t  at  m  r.sdts  sl.lflc.t  at  .05(p(.15  sta  1„  ,re„theses. 
results  significant  at  p<.15  In  both  HPS  and  «9.centec8Jiple3. 


(t) 


(t) 
(t) 
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For  NDCS  purposes  the  important  conclusion  to  be 
drawn  from  this  set  of  results  is  that  effects  of  the  policy 
variables  are  very  much  tied  to  the  classroom  situation.  In 
raore-or-less  standardized  situations  the  CFI  measures  tend  to 
reflect  powerful  and  enduring  influences  of  general  develop- 
mental status  and  family  background.  When  used  in  natural 
group  settings,  the  CFI  captures  group  dynamics  that  are  subject 
to  influence  by  certain  regulatable  center  characteristics. 
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CHAPTER  SEVEN;     CHILD  OUTCOMES  AND  PHILD  CARE  POLICY 


Unlike  most  previous  studies  of  the  impact  of 
group  care  on  young  children,  the  National  Day  Care  study 
(NDCS)  had  a  broad  mandate:     to  trace  the  connections 
between  a  wide  range  of  regulatable  center  characteristics 
on  the  one  hand  and  both  quality  and  costs  on  the  other.  Of 
the  three  domains,  quality  clearly  poses  the  most  difficult 
conceptual  and  technical  problems.     Philosophical  disagree- 
ments as  to  its  definition  abound;  instruments  adequate  to 
measure  all  of  its  aspects  do  not  exist. 

^^^^cts  and  quality  are  not  identical  but  are 
intimately  linked.    The  effects  of  different  day  care  center 
arrangements  are,  in  principle,  objective  matters,  although 
they  may  be  difficult  to  conceptualize  and  measure.  Assessing 
quality  requires  that  value  judgments  be  placed  on  different 
patterns  of  effects.    There  are  many  open  questions  in  the 
developmental  research  literature  and  in  the  practical  lore 
of  child  care  regarding  the  objective  effects  of  different 
center  characteristics. 

A  major  assumption  of  the  NDCS  was  that  judgments 
gf_gual.lty  should  rest  on  direct  assessment  of  the  child's 
daily  experience  and  its  developmental  impact,     such  judgments 
could  not  be  based  simply  on  characteristics  of  centers  such 
as  numbers  of  staff  and  children,  background  qualifications 
of  staff,  or  features  of  the  physical  environment,  indeed, 
the  whole  purpose  of  the  NDCS  effects  analyses  was  to 
determine  whether  such  center  characteristics  have  the  kinds 
of  impacts  on  day  care  processes  and  outcomes  assumed  by 
current  federal  purchasing  standards,  the  FIDCR,  and  some 
state  and  local  licensing  requirements. 

CFI  findings  show  that  certain  regclatable  center 
characteristics  are  consistently  associated  with  patterns  of 
child  behavior  and,  by  inference,  with  the  quality  of  day 
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care  settings.     Smaller  groups  of  children  and  caregivers 
and,  to  a  lesser  extent,  higher  staff/child  ratios  are 
associated  with  more  desirable  classroom  behavior.  Moreover, 
aspects  of  caregiver  qualifications,  especially  education/ 
training  relevant  to  young  children,  are  associated  with 
positive  classroom  dynamics* 


•  In  smaller  groups,  as  contrasted  to  larger  ones, 

— children  show  more  cooperation,  verbal  initiative 
and  reflective/innovative  behavior;  and 

— children  show  less  hostility  and  conflict  and  are 
less  frequently  observed  to  wandar  aimlessly  or  to 
be  uninvolved  in  tasks  or  activities. 

•  In  higher-ratio  classes,  as  opposed  to  those  with 
lower  staff /child  ratios , 

— children  show  greater  task  persistence  and  are 
less  frequently  observed  to  wander  or  be  unin- 
volved in  activities. 

•  In  classes  supervised  by  lead  teachers  with  child- 
related  education/training 

— children  show  more  reflection/innovation,  cooper- 
ation, greater  task  persistence  and  interest/par- 
ticipation and  are  less  frequently  uninvolved  in 
tasks  or  activities. 


The  NDCS  included  a  variety  of  measures  and  data 
collection  instruments  (Bache,  1980),     SRI  selected  two  observa- 
tion systems — one  focused  on  children  and  one  on  caregivers — to 
record  daily  behavior  in  considerable  detail.     In  addition, 
children  were  tested  at  two  points  in  the  year  using  two 
tests  of  school-performance  related  skills,  the  Pre~School 
Inventory  (PSI)   and  the  Peabody  Picture  Vocabulary  Test 
(PPVT) .     For  these  tests,  the  gain  in  child  performance  over 
the  year  was  the  measure  analyzed  (Goodrich  and  Singer,  1980). 


Analyses  were  conducted  to  explore  links  between 
child  behavior  and  changes  in  PSI  and  PPVT  scores,  and  to 
gain  additional  insight  into  the  effects  of  regulatable 
characteristics  on  behavior  in  the  classroom.    These  analyses 
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showed  that  certain  caregiver  and  child  behaviors,  which  are 
influenced  by  group  size  and/or  child-related  education/ 
training  of  staff,  in  turn  are  associated  with  particular 
rapid  gains  on  one  or  both  of  the  two  tests,  even  with  the 
policy  variables  controlled  (Singer,  1980). 

In  centers  where  children  had  high  levels  of 
cooperation,  PSI  gains  were  large  (r=.42,p<.01) .  Similarly, 
PSI  gains  were  large  in  centers  where  children  were  frequently 
engaged  in  reflective,  innovative  behavior  ( r=. 43 ,p< .01) . 
in  centers  were  children  were  allowed  to  wander  aimlessly, 
uninvolved  in  tasks  and  activities,  PSI  gains  were  small 
(r=.32,p<.05) .     PSI  gains  were  also  somewhat  sensitive  to 
the  degree  of  structure  in  classroom  activities.  Centers 
where  structured  activities  predominate  showed  higher  gains 
than  centers  where  unstructured  activities  predominate 
(r=.24,p<.10) . 

All  of  the  above  relationships  are  observed  even 
when  group  size  is  held  constant.     Together  with  group  size, 
various  combinations  of  the  child  behaviors  just  listed 
explain  up  to  40  percent  of  total  center-to-center  variation 
in  PSI  gains  (Singer,  1980).     In  light  of  the  reliabilities 
of  the  various  measures  involved,  this  fraction  presents  a 
very  substantial  proportion  of  the  variation  (Bache,  1980a). 
These  findings  help  put  NDCS  findings  on  test  performance 
into  perspective,  showing  that  rapid  gains  do  not  somehow 
occur  automatically  in  small  classes.     Rather,  rapid  gains 
can  be  expect:ed  where  children  are  active  and  engaged. 
Activity  and  engagement  are  more  common  in  small  groups  than 
in  large  ones— and  when  they  occur,  the  prognosis  for  test 
performance  is  good. 

Gains  on  the  ppvt  are  linked  to  somewhat  diferent 
aspects  of  classroom  dynamics  than  are  PSI  gains.     As  with 
PSI,  reflective,  innovative  behavior  of  children  was 
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associated  with  rapid  gains  on  the  PPVT  (r=. 32,p< .05) ,  and 
aimless  wandering  was  associated  with  slower  gains  (r=.32, 
p<.05).     However,  several  caregiver  behaviors  that  showed  no 
relationship  to  PSI  gains  did  appear  to  affect  ppVT  gains: 
Gains  were  more  rapid  in  centers  where  caregivers  showed 
high  levels  of  interaction  with  children,  both  social 
(questioning,  instructing,  responding,  praising  and  comfort- 
ing)  and  managerial   (commanding  and  correcting) .     Gains  were 
slower  in  centers  where  caregivers  spent  relatively  high 
proportions  of  their  time  observing  children.    When  various 
caregiver  behaviors  were  combined  with  information  on  the 
size  of  subgroups  around  the  caregiver,  regression  equations 
accounted  for  almost  half  of  the  center-to-center  variation 
in  PPVT  gains  (Singer,  1980).     Comparison  of  the  results  for 
the  PSI  and  PPVT  suggests  that  PSI  gains  may  have  depended 
more  on  the  child's  own  activities,  while  PPVT  gains  were 
more  responsive  to  interaction  with  the  caregiver. 

It  is  natural  to  suppose  that  policy  conclusions 
should  be  used  primarily  on  very  strong  statistical  relation- 
ships and  that  weak  relationships  constitute  a  less  useful 
basis  for  policy  decisions.     However,  strengths  of  associa- 
tion can  be  misleading,  and  weak  relationships  can  be 
informative  for  policy,  partly  because  technical  factors 
conspire  against  statistically  strong  findings  in  large 
scale  studies  such  as  the  NDCS,  and  partly  because  statis- 
tical strength  does  not  necessarily  reflect  substantive 
importance  to  children. 

Previous  national  evaluations  of  outcomes  associated 
with  different  levels  of  resource  outlay  in  education  or 
with  program  variations  within  early  intervention  projects 
have  typically  shown  that  measure  3  effects  of  variations  in 
programs  or  resources  are  small.     Often  effects  due  to 
program  differences  cannot  be  detected  at  all.     This  may  be 
true  for  all  of  several  reasons.     Outcome  measures  or 
research  designs  may  lack  the  sensitivity  to  detect  effects 


of  variations  in  programs  or  resources.     Program  differences 
may  be  poorly  defined,  implemented  or  measured.  Finally, 
differences  in  outcomes  may  be  genuinely  small  relative  to 
the  effects  of  the  program  per  se  (e.g.,  of  school  itself, 
or  of  early  intervention  itself)  or  relative  to  the  effects 
of  other  factors  such  as  the  socioeconomic  backgrounds  of 
the  children  served. 


The  NDCS  had  to  contend  with  some  of  the  limits  of 
instrumentation  and  design  that  confronted  earlier  studies, 
some  measures,  in  particular  the  CPI,  were  less  reliable 
than  would  have  been  ideal,  and  some  aspects  of  children's 
development  could  not  be  measured.     For  statistical  reasons, 
limited  reliability  of  measures  leads  to  systematic  under-  ' 
estimation  of  the  true  strengths  of  relationships  and  can 
prevent  genuine  relationships  from  being  detected.  Moreover, 
because  many  center  characteristics  had  to  be  studied  as 
they  occurred  naturally,  these  characteristics  were  not 
fully  independent  of  each  other,  creating  some  difficulty  in 
disentangling  their  effects.     The  NDCS  was,  in  effect,  a 
search  for  signals  in  a  noisy  environment,  as  is  often  the 
case  in  large-scale  policy  studies. 

On  the  other  hand,  the  NDCS  had  advantages  over 
previous  studies.     It's  independent  variables,  particularly 
those  relating  to  classroom  composition  (number  of  children 
and  number  of  caregivers),  were  defined  clearly  and  measured 
precisely,     m  addition,  the  study's  dependent  variables 
included  observational  measures  of  an  unusually  broad  range 
of  child  and  caregiver  behaviors,  as  well  as  test  scores. 
Therefore,  the  opportunity  to  detect  effects  in  this  study 
was  significantly  greater  than  in  studies  that  use  narrow 
sets  of  outcome  measures  or  that  focus  on  effects  of 
programs  that  may  have  differed  less  in  reality  than  in 
theory. 
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In  sum,  the  NDCS  had  advantages  over  previous 
studies  but,  nevertheless,  faced  important  technical  con- 
straints.    It  was  not  at  all  certain  that  the  study  would  be 
able  to  find  systematic  differences  among  classrooms  or 
centers,  or  that  such  differences,  if  found,  would  be  linked 
to  any  of  the  study's  policy  variables.     For  all  of  these 
reasons,  it  can  be  argued  that  the  magnitudes  of  the  various 
relationships  obtained  are  secondary.     The  most  important 
aspects  of  the  NDCS  effects'   findings  are  the  following: 
(1)  the  existence  of  statistically  significant  relationships 
between  policy  variables  and  day  care  quality,  reflected  in 
caregiver  behavior,  child  behavior,  and  test  scores;   (2)  the 
relative  strengths  of  different  policy  variables — the  fact 
that  some  policy  variables  are  clearly  related  to  quality, 
while  others  are  not;   (3)  the  directions  of  relationships 
between  policy  variables  and  measures  of  quality;  and  (4) 
perhaps  most  important,  the  consistency  of  findings — the 
fact  that  the  relatively  independent  sets  of  quality  mea- 
sures— caregiver  behavior,  child  behavior  and  test  scores — 
all  point  to  the  importance  of  the  same  policy  variables — 
classroom  composition  (especially  group  size)  and  child 
related  education/training. 
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INTRODUCTION  AND  ABSTRACT 


Two  of  the  most  important  dependent  measures  in 


the  National  Day  Care  Study  (NDCS)  are  the  Preschool 
Inventory  (PSI)  and  the  Peabody  Picture  Vocabulary  (PPVT) 
tests,  each  of  which  was  administered  in  October,  1976  and 
May,  1977.     These  tests  are  regarded  as  measures  of  certain 
areas  of  cognitive  development  that  may  be  accelerated  or 
decelerated  by  environmental  input.     Bache  (1980)  discussed 
these  cognitive  areas  and  other  psychometric  considerations 
in  a  separate -report.     This  report  concentrates  not  on  the 
psychometric  meaning  of  the  measures  but  rather  on  the 
analysis  of  the  influence  of  day  care  characteristics  on 
cognitive  development.     Because  the  dependent  measures 
assess  a  complex,  continuing,  developmental  process  that 
occurs  for  all  children  whether  or  not  they  are  enrolled 
in  day  care  programs,  and  because  there  are  many  potential 
influences  on  the  process,  the  analysis  is  complex.  This 
report  presents  a  step-by-step  description  of  the  cognitive 
effects  analyses,  and  their  methodological  foundation.  The 
folio-    ng  paragraphs  summarize  the  content  of  each  chapter. 

(1)  Measurement  of  Cognitive  Change 


change  rather  than  on  absolute  level.     The  development  of 
valid  measures  of  change  for  the  PSI  and  PPVT  began  with  an 
analysis  of  the  distribution  of  longitudinal  test  score 
growth  curves.     This  statistical  analysis  led  to  the  con- 
struction of  "Generalized  Change  Scores"   (GCS)  that  most 
accurately  reflect  influences  such  as  that  of  the  day  care 
environment.     The  technique  is  closely  related  to  Bryk's 
(1977)   "value-added"  analysis. 


The  cognitive  effects  analysis  focuses  on  cognitive 


(2) 


Analysis  of  Child  Level  Background  Effects  on 
PSI  and  PPVT  Change   :  


Generalized  Change  Scores  were  used  as  dependent 
measures  in  child-level  regressions  against  child  background 
variables.     It  was  determined  that  so  little  variance  is 
predicted  by  background  variables  such  as  socioeconomic 
status  that  they  can  be  virtually  disregarded  in  analyses. 
Thus,  complicated  "covariable  adjustment"  strategies  are 
unnecessary.    A  small  adjustment  for  race  of  child  was 
retained  for  analyses  of  the  PPVT. 

(3)  The  Unit  of  Analysis 

The  classroom  is  not  a  practical  choice  as  unit  of 
analysis  because,  in  most  cases,  their  enrollments  are  con- 
tinually changing.     Thus,  the  UOA  must  be  the  child  or  the 
center.     It  was  demonstrated  that  statistically  and  practically 
significant  intracenter  correlation  effects  exist  and  are 
large  enough  to  invalidate  hypothesis  testing  at  the  child 
level.    Therefore,  the  center  was  selected  as  the  UOA.  Each 
center  was  weighted  by  the  number  of  children  it  contributed 
to  the  sample  in  order  to  minimize  variance  of  statistical 
estimates  and  to  obtain  unbiased  hypothesis  tests. 

Child  and  Center  Components  of  Variance 

The  relative  importance  of  child  and  center  level 
effects  was  assessed  by  calculating  the  child  and  center 
level  variance  components.     Prom  these  the  generalizability* 
of  center  means  was  calculated.     It  was  shown  that  the 
center  level  component  of  variance  of  cognitive  change  is 
statistically  and  practically  significant,  and  that  center 


*i?  al^^ag?^)?^  °^  reliability.     See  Cronbach 
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level  means  are  of  sufficient  generalizability  to  permit 
useful  center-level  analyses.  This  further  supports  the 
choice  of  the  center  as  unit  of  analysis. 

f  5)  Fallibility  of  Dependent- and  Independent  Measures 

An  analysis  of  the  effect  of  measurement 
error  on  the  center-level  regression  model  is  presented; 
correction  formulas  are  given  for  the  required  multivariate 
disattenuation  correction. 

(6)  Center  Level  Cognitive  Effects  Analysis  and 

Validation  of  Findings 

Classroom  organization  variables  (group  size, 
staff/child  ratio,  number  of  teachers  and  aides)  and  care- 
giver qualifications  were  shown  to  be  significantly  asso- 
ciated with  cognitive  gains.     Several  effects  models  were 
constructed.     Effects  were  validated  by  (1)  cross-validation 
across  segments  of  the  sample,  emphasizing  the  correspondence 
of  results  from  a  sample  of  eight  centers  from  the  Atlanta 
Public  School  System  and  those  from  the  remaining  centers; 
(2)  robust  regression  techniques  to  reduce  the  influence  of 
outliers  on  overall  conclusions?  (3)  sensitivity  analysis  of 
weighting  by  center?   (4)  analysis  of  sensitivity  to  outlier 
centers?   (5)  analysis  of  sensitivity  to  center  level  measures 
(6)  comparison  of  results  from  the  PSI  and  the  PPVT. 
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CHAPTER  ONE;     MEASUREMENT  OF  COGNITIVE  CHANGE 


Why  Must  We  Measure  Cognitive  Change? 

The  purpose  of  the  Phase  III  cognitive  effects 
analysis  was  to  determine  influence  of  center  level  day  care 
variables  (especially  those  regulatable  by  public  policy)  on 
children's  cognitive  development,  controlling  for  external 
influences  unrelated  to  the  day  care  experience.  The 
available  data  include  (1)  pretest  and  posttest  scores  on 
two  cognitively  oriented  tests,  (2)  a  number  of  center 
descriptive  characteristics,  and  (3)  observations  of  staff/ 
child  ratio,  group  size,  numbers  of  caregivers,  and  measures 
of  education  and  experience  of  observed  caregivers. 
The  observationally  based  data  were  collected  during  morning 
hours  five  times,  at  approximately  six  month  intervals, 
between  pretest  (T3:  October,  1976)  to  posttest  (T4:  May, 
1977).*    The  tests  measure  two  dimensions  of  the  complex 
process  of  cognitive  development,     in  order  to  separate  day 
care  effects  from  maturation  and  status  (background) 
effects,  the  study  must  focus  on  the  process  of  developmental 
change,  an  exceedingly  complex  and  controversial  methodolog- 
ical area  (Cronbach  and  Furby,  1970). 

Measures  of  changes  were  constructed  by  statis- 
tical analysis  of  entire  growth  trajectories  and  their 
longitudinal  characteristics,  in  a  formulation  related  to 
that  of  Bryk  and  Weisberg  (1977),  and  Bryk  (1977).  These 
measures,  termed  generalized  change  scores  (GCS) ,  were  used 
directly  as  dependent  variables  in  effects  analyses. 

This  choice  of  analytic  method  was  not  the 
only  considered.  In  particular,  we  considered  using 
the  posttest  score  directly  as  the  dependent  measure  and 


*See  Bache  (1980a)  for  a  description  of  these  measures. 
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the  pretest  score  as  one  of  the  independent  variables.  We 
rejected  this  approach  for  the  following  reasons. 


(1)     The  approach  is  not  a  dynamic  one  even  though 


the  process  is.     It  applies  traditional  static  analysis  to  a 
problem  where  change  is  the  construct  of  direct  psychological 
interest. 

(2)  By  viewing  the  problem  longitudinally 
it  is  possible  to  construct  a  measure  of  change  that 
minimizes  chances  of  bias  due  to  improper  correction  for 
maturational  differences  across  the  study  population, 
(See  Bryk  and  Weisberg,  1977,) 

(3)  Test  generalizabili ties  (Cronbach  et  al,, 
1972)  can  be  accurately  computed  from  longitudinal 
analysis  of  whole  scores,  without  reliance  on  internal 
consistency  criteria.     Longitudinally  derived  measures  of 
change  require  no  additional  correction  for  attentuation 
effects. 

The  following  sections  detail  development  of 
an  appropriate  measure  of  change. 

Description  of  Tests 


the  Preschool  Inventory  (PSI)  test  in  the  shorter  32  item 
version  (Educational  Testing  Service,  1970),  and  the 
Peabody  Picture  Vocabulary  Test  (Dunn,  1959);  Meissner, 
Shipan,  and  Gilbert,  1972),     A  few  motor  development  items 
were  also  administered  but  did  not  yield  a  sufficiently 
reliable  motor  development  scale.     The  PSI  is  a  measure  of 
certain  school-relevant  aspects  of  skill  and  general 
knowledge;   it  has  been  used  in  several  previous  studies, 


The  two  cognitive  measures  used  in  Phase  III  are 


including  Head  Start  Planned  Variation  (HSPV)  and  the  Home 
Start  evaluation  (Love  et  al.,  1976) •     The  PPVT  is  a  widely 
used  measure  of  receptive  language  functioning .  Although 
both  the  PS  I  and  ppvt  correlate  highly  with  Stanford-Binet 
scores,  they  are  not  viewed  as  intelligence  tests  in  the 
National  Day  Care  Study.     Both  tests  are  useful  measures  of 
school  readiness  in  regular  classroom  settings.    A  detailed 
psychometric  analysis  of  the  PPVT  and  the  PS  I  in  the  NDCS 
and  other  studies  is  provided  by  Bache  (1980b). 

Growth  System  Theory 

An  important  premise  of  the  cognitive  analysis 
is  that  the  data  can  be  thought  of  as  longitudinal  measures 
(with  measurement  error)  on  a  set  of  growth  trajectories 
that  together  comprise  a  "growth  system."    Each  trajectory 
represents  the  growth  of  one  particular  individual  from  the 
population  of  interest.     This  premise  was  first  stated 
clearly  by  Bryk  and  Weisberg  (1977),  and  was  further  eluci- 
dated by  Bryk  (1977),  Strenio  (1977),  and  Goodrich  (1978). 
It  has  led  to  the  formulation  of  growth  system  theory, 
bringing  together  ideas  in  developmental  psychology, 
ordinary  statistics,  and  stochastic  systems  theory.     It  is 
the  statistical  distribution  of  whole  trajectories,  rather 
than  single  measurements,  that  is  the  object  of  study.  To 
provide  an  orientation  to  this  problem,  we  will  first 
consider  it  under  simplifying  assumptions  made  originally  by 
Bryk  and  Weisberg: 

(1)     Each  individual  growth  curve  (trajectory)  is 
a  smooth,  deterministic  function  characteristic  of  the. 
individual.     Trajectories  differ  randomly  from  individual  to 
individual.     If  the  trajectory  for  an  individual  can  be 
identified,  the  future  growth  of  the  individual  can  be 
predicted. 
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(2)     Each  curve  is  linear  (perhaps  in  a  transformed 
metric),   so  that  it  can  be  described  by  the  level  a  and 
slope  B  at  a  reference  age.     Thus,   if  a  and  B  are  known, 
the  entire  curve — past,  present,   and  future — is  known. 

In  this  formulation,  the  growth  characteristics 
of  a  population  are  described  by  the  joint  distribution  of 
(ot,  B  ).     Assuming  normality,  the  distribution  is  determined 
by  the  mean  (a,         and  elements  of  the  variance-covariance 
matrix  Gov  (a,  B).     It  is  common  in  evaluation  theory 
to  adjust  for  differences  across  populations  by  controlling 
for  pretest  scores.     Bryk  and  Weisberg  showed  that,  except 
under  very  special  circumstances,  this  adjustment  technique 
is  biased. 

Some  of  the  distinct  growth  patterns  that  can 
occur  are  shown  in  Figure  1-4,  adapted  from  Bryk  and 
Weisberg.     These  growth  systems  can  be  used  to  demonstrate 
how  adjustment  bias  arises. 

In  Figure  1-1   (Fan  Spread),   the  differences  among 
individuals  tend  to  increase  with  time,   i.e.,  those  who  are 
further  ahead  initially  tend  to  learn  at  faster  rates.  In 
Figure  1-2,    (Fan  Spread  with  Crossing),   two  groups  are 
represented.     Within  group,  differences  tend  to  increase  as 
in  ordinary  fan  spread.     However,  the  group  that  was  initially 
behind  overtakes  and  surpasses  the  initially  more  advanced 
group. 

In  Figure  1-3  (Fan  Close),  differences  among 
individuals  tend  to  decrease  (and  the  curves  would  eventually 
cross).     Fan  close  effects  (but  not  crossing)  can  be  caused 
by  test  ceiling  effects.     Figure  1-4  (Degenerate  Fan  Spread) 
is  simply  fan  spread  in  which  all  individuals  are  initially 
equal. 


Fan  Spread 
Figure  1-1 


Fan  Spread  with  Crossing 
Figure  1-2 


There  are  obviously  many  other  patterns  of  growth 
that  might  occur — especially  if  trajectories  are  curvilinear. 
Nevertheless,  these  simple  examples  suffice  to  show  that 
bias  occurs  in  the  most  frequently  applied  adjustment 
methods.     The  magnitude  of  bias  depends  on  the  specific 
change  measure  used,  and  the  nature  of  underlying  differ- 
ences in  growth  characteristics, 

Kenny  (1975)  demonstrated  that  the  results  of  an 
evaluation  depend  on  the  particular  means  used  to  construct 
the  change  measure.     He  considered  four  change  measures 
(residual  change,  residual  change  with  Lord-Porter  correction, 
raw  change,  and  standardized  change)  and  showed  that  the 
null  hypothesis  has  a  different  algebraic  form  in  each  case. 
Table  1,1  lists  these  null  hypotheses  for  Kenny's  four  measures 
and  for  the  general  linear  change  score  form.     Each  null 
hypothesis  in  Table  1,1  is  stated  in  terms  of  the  covariance 
of  a  function  of  population  parameters  and  a  treatment 
variable  T,  which  may  either  be  a  dummy  variable  or  an 
interval  variable,  such  as  group  size  or  staff-child  ratio. 
Assume  that,  in  fact,  there  is  no  effect.     Unless  the  popu- 
lations are  truly  equivalent,  at  most  one  of  the  alternative 
null  hypotheses  can  be  true — since  they  all  state  different 
things.     Unless  the  analyst  has  selected  the  "right"  change 
measure,  he  or  she  will  erroneously  conclude  (for  large 
enough  sample  size)  that  an  effect  actually  exists.  The 
subject  of  this  chapter  is  the  identification  of  the  "right" 
change  measure  through  longitudinal  analysis  of  the  growth 
curves , 

In  practice,  the  situation  is  considerably  more 
complex  than  that  discussed  so  far — i,e,,  under  the  simpli- 
fying conditions  cited  earlier.     For  instance-  the  assumption 
of  linearity  of  growth  is  usually  not  justified,  at  least 
for  unsealed  measures.     The  PSI  test  used  in  Phase  II  of  the 
NDCS  has  only  32  items  and  begins  to  exhibit  curvilinear 
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Table  1.1 

NUIX  HYPOTHESES  FOR  ALTERNATE  CHANGE  MEASURES 


Measure  of  Change 


Null  Hypothesis 


Raw  Change  Score 

Standardized  Change 
Score 

Residual  Gain  Score 


Corrected  Residual 
Gain  Score 

General  Form 


yo  - 


^1 


r 


i2_2 
a,  ^1 


^12^2^1 


Gov  j(^2  -  yi)'T]=  0 


Cov 


Cov 


j^Yj  -  By^),T)j=  0 


=  Pretest  Score 
^ -  Standard  Dev.  of 
y2  =  Posttest  score 
o^  -  Standard  Dev.  of  y 
^12      Correlation  of  y;j^,y2 
P  =  Test  Reliability 
T  =  Treatment  Variable 
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ceiling  effects  for  children  as  young  as  4  or  5.     In  addition 
real  growth  trajectories  include  seemingly  random  increases 
or  decreases  associated  with  specific  (but  unpredictable) 
interaction  events  between  child  and  learning  environment, 
as  discussed  by  McCall  et  al.    (1973),  and  Goodrich  (1978). 
The  growth  curves  are,  in  other  words,  not  usually  smooth 
but  "bumpy".     The  longitudinal  analysis  discussed  in  this 
report  uses  new  statistical  techniques  (Goodrich,  1978)  for 
the  study  of  such  complicated  growth  processes. 

Summary.     In  even  a  very  simple  formulation  of  the 
growth  curve  model,  the  character  of  the  model  must  be 
identified  in  order  to  select  an  unbiased  measure  of  change. 
This  fact  has  been  discused  by  Bryk  and  Weisberg,  Kenny,  and 
Goodrich.     Unfortunately,  real  human  growth  is  even  more 
complex  than  the  linear,  determinate  models  assumed  in  this 
section.     The  next  section  extends  the  models  to  provide  a 
more  realistic  description  of  the  growth  process. 

Analysis  of  the  Longitudinal  Subset  of  Children 

Since  the  Phase  III  analysis  involves  only  a  pre- 
and  a  post-test,  measures  of  change  must  be  restricted  to 
simple  alternatives  like  straight  change  scores,  residual 
change  scores,  standardized  change  scores,  fraction  of  items 
learned,  etc.     Potentially  better  measures  of  change  can  be 
constructed  from  longer  sequences  of  longitudinal  data. 
Because  of  this,  we  are  interested  in  the  subset  of  110 
children  for  whom  four  PSI  tests  are  available  (those 
children  that  participated  both  in  Phase  II  and  Phase  III). 
For  this  longitudinal  subject  the  entire  3-4  year  age  range 
is  spanned.     Unfortunately,  the  sample  is  too  small  and 
scattered  across  centers  to  serve  as  a  basis  for  study  of 
center  level  effects.     However,  it  was  valuable  as  a  resource 
to  study  characteristics  of  the  overall  frowth  process,  and 
thus  to  construct  a  "generalized  change  score"   (GCS)   for  use 
in  analyses  of  center  effects  based  on  the  entire  sample. 
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Figure  1-5  illustrates  the  stochastic  nature  of 
these  data,  which  may  be  represented  as  a  set  of  sequences 
^^k,i'  ^I^INJ  where  the  cross-sectional  sample  size 

N  is  110,  and  the  longitudinal  sample  size  is  4  (at  times 
T1-T4).     It  is  assumed  that  the  i'th  child's  measurements 

ll'^lT}  are  jointly  described  by  the  statistical 
distribution  across  the  study  population  of  parameters  that 
describe  each  curve  initially,  a  stochastic  difference 
equation  model  of  growth,  and  a  measurement  error  model  from 
classical  test  theory.     The  parameters  cf  this  model  were 
identified  by  a  maximum  likelihood  technique  that  employs 
the  recursive  Kalman  filter  equations  (Kalman,  1960,  Kalman 
and  Bucy,  1961)  to  construct  the  likelihood  function  and  its 
derivatives.     These  are  used  in  conjunction  with  Newton- 
Raphson  numerical  maximization  in  a  computer  algorithm 
programmed  in  FORTRAN  for  the  CDC  6400.     A  coinplete  descrip- 
tion of  the  model  and  the  identification  technique  was 
provided  by  Goodrich  (1978),  and  by  Goodrich  and  Caines 
(1979a-c)  . 

Three  alternative  stochastic  models  were  con- 
sidered as  descriptors  of  the  PSI  trajectories.  More 
complex  models  could  not  be  considered  because  of  the 
extreme  shortness  of  the  series  available. 

^        ^  fi'^st  order  autoregressive  model  with 
measurement  error  and  deterministic  constant  inputs.  The 
"true"  PSI  score        ..   is  assumed  to  evolve  according  to  the 
stochastic  difference  equation 

1  £    k    <^  3 

=     ^    ^k,i     ^    \,i    ^    \  (1-1) 

1  <     i     <  110 
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Piqure  1-5 


Sanple  Mean  and  Twenty  Randomly  Selected 
Data  Sequences  ■  ■  ■ 


where  (W^^^^)  are  uncorrelated  zero-mean  random  variables 
with  variance  a J  {^^j        ^  sequence  of  unknown  con- 

stants.    The  distribution  of  X^^^  is  assumed  to  be  normal 
with  mean  X^^^  and  variance  V^^^.     Unknown  parameters  in 
^i"^^  ir^clude  the  autoregressive  constant  A,  the  variance 
w       \,i  parameters  (U^), 

Each  measurement        ^  is  related  to  the  corre- 
sponding true  score  X^^^  via  the  classical  test  theory 
measurement  equation: 

\a  =  \.i  ^  \a  (1-2) 

In  this  equation,  the  measurement  errors        ^  are  assumed 
to  be  mutually  uncorrelated  and  to  have  the' common  variance 

The  generalizability    p ,  which  will  depend  on  the  study 
population  as  well  as  the  test,  can  be  computed  from  for 
any  desired  population,   using  the  equation: 


P  =  1  - 


a2  , 
 V 

Var(Z     .)  (1-3) 
k,  1 


The  parameters  to  be  identified  include: 
^'  ^"ic^'  Vo'  VO' 

These  make  up  a  vector  that  will  be  denoted  by  0-     Model  I 
appears  deceptively  simple  because  of  its  linear  difference 
equation  form.     In  fact,   the  equation  describes  a  vast 
family  complex  of  curvilinear  trajectories  with  complicated 
longitudinal  stochastic  behavior. 

Model  II  extends  Model  I  to  second  order  by  allowing 
X  to  be  a  2-dimensional  vector — i.e.,  the  model  is  of 
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••second  order**.  The  equation  corresponding  to  1-1  is  as 
follows: 


^+l,i 


(1-4) 


Z.    .  =  (0  1)  X,    .   +  , 


Model  II  is  a  mixed,  autoregressive  moving  average  model, 
described  by  the  parameters  (A^,  A^,  G^),     The  As  are  auto- 
regressive parameters  while        is  an  "'impulse  response" 
parameter  functionally  related  to  the  As  and  to  a  moving 
average  parameter.     Box  and  Jenkins  label  the  model  ARMA  (1,2), 
The  state        is  a  2x1  vector  whose  second  component  represents 
the  true  PSI  score;  the  initial  state        is  assumed  normal  with 


vector  mean  X 


1/0 


'11 


and  covariance  matrix 


'12 


JL12  ''22 


The  processes 


correspond  to  those  described  earlier.  The  parameter  vector 
is  now 

e=  (A^.  A^.   G^.  02,   o2,  x^^^,  v^^^). 

The  increased  number  of  elements  of  the  parameter  vector 
makes  Model  II  harder  to  identify  accurately  than  Model  I, 

Model  III  extends  Model  I  in  a  different  way. 
While  Model  I  assumes  that  all  subjects  have  equal  mean 
growth  rates.  Model  III  includes  subject-to-subject  differ- 
ences represented  by  the  Term  R  in  the  following  equations. 
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(1-5) 

The  term        is  randomly  distributed  across  the  population 

but  is  constant  within  case.     We  assume  that  X^^  .  and  R.  have  a 

joint  normal  distribution  with  mean  (x^^q,   0)  aAd  covariance 


matrix 


"l/O  V 


SO  that  the  parameter  set  for  the  model 


is  9  =  (A,  a  J,  u^,  X^/Q,  V^/Q,  D^^,  aj,  aj) ,  Model  I  can 
be  derived  from  Model  III  by  setting  =  cj^  =  0-  Thus, 
Model  I  can  be  regarded  as  the  mathematical  expression  of 

the  null  hypothesis  D    =        =  o. 

R  R 

The  flexibility  of  the  stochastic  formulation  can  be 
verified  by  noting  that  it  includes  all  deterministic  linear 
models  discussed  by  Bryk  and  Weisberg  (see  above).     If  one 

oT'  T     °'    =      = ^1/0  = Vo  - 

a   '       R  =  °^B'  °R  =  °  "  °  ^      "  ^'    to  obtain  the 
formulation  described  in  Section  3.1  above.     Model  III 
extends  the  Bryk  and  Weisberg  formulation  to  include  both 
curvilinear  mean  growth  (when  A/1)  and  stochastic  (non- 
deterministic)   fluctuations  (whena2>o). 

w 

Model  Identification 

The  longitudinal  (Phase  Il-Phase  III)   data  were 
analyzed  by  carrying  out  the  following  steps. 

(1)  All  data  were  corrected  to  zero  cross-sectional 
mean  for  each  of  the  four  time  points.     These  reduced  data 
were  analyzed  in  a  series  of  computer  runs  that  tested  the 
fit  of  each  of  the  models  I-III.     On  the  basis  of  asymptotic 
likelihood  ratio  tests,  the  structure  was  determined  to  that 
of  Model  I.     Model  II  was  rejected  at  the  level  .10  and  Model  III 


at  the  level  .08.     Parameter  estimates  and  their  standard 
errors  were  determined  for  the  parameters  A,   ri^,  V^^^,  a^) 
that  occur  in  Model  I. 


(2)  The  cross  sectional  means  (subtracted  out 
for  Step  Dwere  analyzed  to  determine  the  constants 

(U^/  ^2'  ^3'  ^1/0)  assuming  that  (A,  a^,  ^i/o/  ^v^ 
had  the  values  estimated  in  step  (1),   and  using  the 
technique  described  by  Goodrich  (1978).     The  null 
hypothesis  ^1=^2"  ^3  "Ot  rejected  (chi^square  test; 

P  =  .13).     Therefore  it  was  assumed  that  these  constants  were 
equal  for  purposes  of  pareuxieter  estimation.     The  re* 
suiting  parameter  estimates  are  given  in  Table  1-3. 

(3)  The  model  was  checked  and  validated  by 
verifying  that  residuals  were  statistically  uncorrelated, 
that  the  predicted  covariance  matrix  was  not  significantly 
different  from  the  seuxiple  covariance  matrix,   and  that  the 
predicted  mean  curve  achieved  proper  goodness-of-f it  to  the 
observed  mean  grc  th  curve.     Results  of  the  latter  test  are 
exhibited  in  Table  1-4. 


I     ust  Estimates  of  Pareuneters 


Although  ML  estimates  are  asymptotically  efficient 
for  normally  distributed  data,   they  may  not  be  robust  with 
respect  to  severe  departures  from  normality,   especially  when 
sample  sizes  are  small.     Recently  much  attention  has  been 
paid  to  so-called  robust  statistics,  especially  the  jackknife 
method  developed  by  Tukey  (1978)  and  explained  in  detail  by 
Mosteller  and  Tukey  (1978).     In  this  technique,   the  data  are 
divided  into  several  groups.     Then  separate  parameter 
estimates  are  made  for  each  reduced  data  set  obtained  by 
excluding  one  data  group.     Then,   "poeudo-values"  Yj  for 
parameter  estimates  are  calculated  by  the  equation: 

Y*  =  KY^  -  (K-l)Yj,       j  =  1,2,    ...,K  (1-6) 

where  K  is  the  number  of  groups,  Y    ^.vi^  rs^r>-^r^^4.  ^  • 

^  o  the  parameter  estimate 
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Model 

Theoretical 
Lower  Bound 

Model  I 

Model  II 

Model  III 

^pper  bound. 


Table  1.2 
SUMMARY  OF  STATISTICAL  DATA 


Conditioning 
_0f  Hessian 


LLF 


Number  of 
Parameters 


794.32  10 

Good               799.20  4 

Poor               795.42^  8 

Poor               796.7  6 

Pull  minimum  not  achieved. 


Level  of 
Significance 


.14 

null  hypothesis 
.10 
.08 


Table  1.3 

PARAMETER  ESTIMATES  AND  THEIR  STANDARD  ERRORS 
^^^^^^^^  ML  Estimate  Estimated  Standard 


Vio 

^2 


w 

,2 


^1/0 


.909 
17.38 
3.95 
5.18 
11.30 
4.89 


.05 
3.07 
1.52 
1.10 


Sample  Mean 
Predicted  Mean 


Table  1.4 
PREDICTED  MEAN  AND  SAMPLE  MEAN 
Tl  T2  T3 


11.37 
11.30 


14.89 
15.16 


18.16 
18.67 


T4 


21.96 
21. G7 
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using  all  available  data,  and        that  obtained  for  the 
estimate  when  the  j*th  group  was  omitted.    The  jackknife 
estimate  and  its  variance  are  given  by: 

Y*  «  i  ?  Y^  S*2  »  ^    S^,  (1-7) 

2 

where  S    is  the  sample  variance  of  the  pseudo-values. 

In  the  present  application,  eleven  groups  of  10 
subjects  each  were  formed  randomly.     Separate  maximum 
likelihood  (ML)  parameter  estimates  were  made  for  each  of  the 
11  resulting  reduced  data  sets  (see  Table  1-5).     Overall  ML 
estimates  and  conventional  parameter  error  estimates  turned 
out  to  be  close  to  jackknifed  values.     Thus,  simple  ML 
estimates  appear  to  be  reassuringly  robust  for  these  data. 

Summary .    A  subset  of  the  subjects  were  tested  four 
times  in  the  course  of  Phase  II  and  Phase  III.     This  subset 
was  used  to  determine  an  underlying  growth  model  that 
adequately  describes  both  mean  growth  and  subject-to-subject 
differences.     The  simplest  model,  denoted  ARMA(1,0)  with 
measurement  error  by  Box  and  Jenkins,  was  selected  by 
statistical  hypothesis  testing.    Model  parameters  were 
determined  and  shown  to  be  robust.     The  next  section  shows 
how  a  measure  of  change  was  derived  from  the  identification 
of  the  underlying  growth  model. 

PSI  Measures  of  Change 

Longitudinally  Based  Measure  of  Change 

It  was  determined  that  the  distribution  of  PSI 
developmental  trajectory  data  is  described  by  the  following 
stochastic  difference  equation  model: 


256 

230 


ESTIMATES 


Table  1-5 
OBTAINED  BY  JACKKNIFE  METHOD 


ML  Estimates 

Entire  Sample 

1 

2 

3 

4 

5 

6 

7 

8 

9 
10 
11 

Jackknife 
Estimate 

SD  of 

Jackknife 

Estimate 

Conventional 
Estimate  of  SD 


A 

.90949 

•90686 

.90547 

.90223 

.90802 

.91361 

.90841 

.92226 

.89182 

.90115 

.90642 

.93534 

.91249 

.0348 
.0519 


a  2 
w 

3.94711 

3.57428 

4.56481 

3.78566 

4.22483 

4.11079 

4.07115 

3.00405 

5.28138 

4.54255 

3.73532 

2.69613 

3.79007 

2.414 
1.522 


a2 

V 

5.17759 

5.14253 

4.77656 

5.31813 

5.05623 

5.07464 

5.15885 

5.74061 

4.53196 

5.05568 

5.33622 

5.59384 

5.28226 

1.035 
1.099 


^1/0 
17.37589 
18.16757 
19.00743 
17.90313 
16.90015 
17.33767 
17.03517 
17.40330 
16.43901 
16.89951 
17.14301 
16.40833 

17.8218 

2.332 
3.071 
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(1-8) 

where 

^  =  .91    o^^  =  3.55    o*^  =  5.18 

'u  a  4.89  X,  .  =  11.3 
Vo  =  Var  X,   .  =  17.4 

This  model  is  the  best  fit  to  the  110  longitudinal  records 
that  does  not  involve  any  center  level  explanatory  variables 
(e.g.,  staff-child  ratio).     In  this  section  we  develop  a 
measure  of  change  based  on  Model  I.    This  measure  of  change 
will  then  be  used  to  evaluate  the  effects  of  center  level 
variables. 


The  principle  to  be  used  is  a  modification  of  the 
"value-added"  principle  originated  by  Bryk  and  Weisberg  (see 
Bryk,  1977).     First,  a  forecast  of  the  posttest  score  based 
on  all  available  prior  data  and  known  trajectory  statistics 
is  computed.     Then  the  "value  added"  is  computed  as  the 
difference  of  the  actual  and  forecasted  posttest  score. 
This  difference  between  optimal  forecast  and  actual  measure 
can  be  attributed,   in  part,  to  events  that  occur  between 
pre-  and  posttests — i.e.,  to  the  day  care  environment. 
The  method  presented  by  Bryk  and  Weisberg  and  the  method 
presented  here  differ  principally  in  the  technique  that  is 
used  to  prepare  the  forecast  posttest  score.    While  Bryk  and 
Weisberg  use  cross-sectional  data  to  calculate  a  mean  growth 
curve  (and  hence  estimated  growth  increments  at  any  age),  we 
use  principles  borrowed  from  time  series  theory  to  prepare 
an  optimal  forecast  based  on  the  underlying  growth  model. 

It  is  well  known  (see,  e.g.,  Astrom  (1970))  that 
the  optimal  (i.e.,  minimum  variance)  forecast  of 


2,i 
fol 

First,  a  minimum  variance  estimate  of  the  true  score  X 


based  on  the  previous  measure  Z     .  is  prepared  as  follows. 

1  #  1 


is  calculated  by  the  formula 
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''1/0        ''v        ^1/0  °v 

The  right  hand  side  of  this  equation  is  a  weighted  average 
of  the  measured  score  and  the  population  mean  score. 
Second,  the  forecast  value  of  z^  .^  is  calculated  by  the 
equation  ' 

'^2/l,i  =  A  h.i  +  (1-11) 
so  that  the  value  added  is  given  by  the  formula: 


The  relative  weights  from  equation  1-12  were  determined  to 
be  given  by: 


a 


2 


V, 


  =  .23  _2     ^         =  (1-13) 


In  the  present  applications,  formula  (1-12)  was  first 
replaced  by  the  simpler  form 

A  i  =  Z2  i  -  A        .j^  +  constant  (1-14) 

This  still  produces  an  unbiased  estimate  of  the  effect 
\,i  give"  the  pretest  score.     The  result  is  an  unbiased, 
near  optimal  calculation  for  value-added  that  is  termed 
the  "generalized  change  score".     The  constant  is  irrelevant 
to  effects  calculations,  and  can  be  omitted  without  loss,  to 
obtain  the  form 
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since  the  data  to  be  analyzed  are  from  Phase  II # 
Z     .  is  the  test  score  at  T4  and  Z,    .  is  that  from  T3, 

It  thus  turns  out  that  Model  I  has  led  to  the 
identification  of  the  residual  change  score,  disattenuated 
for  reliability  effects,  as  the  appropriate  change  score  to 
use  for  the  PSI  data.     Normally  one  obtains  the  disattenuated 
residual  change  score  by  first  regressing  posttest  scores 
against  pretest,  and  then  dividing  the  regression  coefficient 
by  the  test  reliability.     Suppose  that  the  regression 
equation  so  obtained  is 

^2.i  =  ^  ^l.i  +  C  +  ^i' 

and  that  the  test  reliability  is  P,     Then  the  disattenuated 
residual  change  score  is 

^2,i  "  §  2l,i' 

the  same  form  determined  through  our  longitudinal  analysis. 
In  fact,   using  P  =  .85  (Cronbach's  alpha  for  the  PSI)  it 
was  determined  that 


This  is  a  remarkable  convergence  with  the  value  ,91  obtained 
from  the  longitudinal  analysis.     Note  that  if  the  best 
fitting  model  hacl  been  more  complex  than  Model  It  the 
generalized  change  score  would  have  contained  more  terms  and 
the  similarity  to  the  disattenuated  residual  change  score 
would  be  less  close. 
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The  coefficient  A  for  the  model  of  the  form  given 
by  (1-8)  can  be  estimated  by  yet  a  third  method  if  age-test 
covariances  are  known.     Since  W^^  ^  is  assumed  to  be 
uncorrelated  with  age,  we  find  that 


Gov  (Y, 


k+1 


,i'  ^)  =  A  GOV  (V^^.,  a.) 


where  a^  is  the  age  of  subject  i.  Therefore,  we  can  estimate 
A  via 


'J  _  Gov  (T4fa) 
Gov  (T3,a) 


(1-15) 


from  T3,  T4  covariances  with  age.     Use  of  the  formula  yields 
A  =  .88  based  on  the  Phase  III  sample  of  approximately  500 
children. 

If  change-measures  are  not  statistically 
independent  of  age  then  aggregation  to  center  level  would 
result  in  measures  whose  expected  value  depended  on  the  age 
distribution  in  the  center.     It  would  be  necessary  to  use 
age  as  an  independent  variable  in  analyses.     However,  for 
any  of  the  suggested  estimation  techniques,  relatively  age- 
insensitive  measures  result.     This  is  another  verification 
that  the  model  fits  the  growth  curves  very  well  over  their 
entire  range.     Age,  in  this  formulation,   is  merely  an 
indexing  variable  with  no  causal  role  in  the  analysis. 

Table  1-6  summarizes  results  obtained  by  the  three 
different  methods.     The  convergence  exhibited  in  the  table 
builds  confidence  that  the  PSI  growth  curve  system  has  been 
properly  identified. 
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Table  1-6 

SUMMARY  OF  RESULTS  FROM  DIFFERENT  ESTIMATION  METHODS 


Estimate  Estimate 
of  B  of  P 


Longitudinal  110  91+.05      Longitudinal  .87 

Regression  with 

L-P  Correction  800-900  .86        Cronbach's  a  .85 

Age-Covariance 

Method  800-900  .88 


Summary 

The  generalized  change  score  (GCS)  is  the  difference 
between  the  observed  posttest  score  and  the  optimal  predicted 
posttest  score  based  on  early  information.    A  simplified 
form  of  the  generalized  change  score. was  derived  for  use  in 
analyses  of  center  effects.     Because  of  the  simplicity  of 
the  underlying  growth  dynamics  the  GCS  reduces  to  the 
disattenuated  residual  change  score.     Three  different 
methods  of  calculation  of  the  GCS  lead  to  approximately  the 
same  result: 


A  =  Zz,i  -  Zi,i 

This  form  was  used  for  analyses  of  center  effects,  described 
in  the  next  section. 
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CHAPTER  TWO;     ANALYSIS  OF  CHILD  LEVEL  BACKGROUND  VARIABLES 


In  many  cases  the  effects  determined  in  quasi- 
experimental  studies  depend  on  the  particular  techniques 
selected  to  adjust  for  nonequivalence  of  treatment  and 
comparison  groups.     For  instance,  the  Head  Start  evaluation 
shows  negative  Head  Start  effects  using  ANCOVA  and  positive 
effects  using  Magidson's     (1977)   "true  score"  model. 
A  vast  literature  on  the  problem  exists,  but,  unfortunately, 
there  is  no  consensus  on  the  best  methods  to  employ,     m  the 
current  study,  reliance  on  ANCOVA  or  other  statistical 
adjustments  was  minimized  by  (1)  attention  to  the  problem  in 
the  design  phase,  i.e.,  by  balancing  race,  social  class,  and 
other  status  measures  whenever  possible  and  (2)  choice  of 
the  GCS  method  for  evaluation ^of  cognitive  growth. 

In  this  section  we  will  investigate  effects  of 
background  variables  on  generalized  cognitive  change  scores 
at  the  child  level.     Table  2-1  lists  the  background  variables 
considered  in  the  analysis,  including  child-,  neighborhood- 
and  center-level  variables.    Center-level  variables  were 
obtained  by  aggregating  over  child-level  variables,  while 
neighborhood  variables  are  from  1970  census  tract  data. 
Only  child-level  variables  are  considered  in  this  section, 
since  interest  centered  on  the  effect  of  background  variables 
at  the  child  level. 

Missing  data  were  a  problem  in  the  analysis. 
Only  489  cases  included  required  test  data  and  the  full  list 
of  child-level  covariables.     These  489  cases  were  analyzed  in 
stepwise  regression  runs  (change  measure  agai.iSt  covariables); 
results  are  displayed  in  Tables  2-2  to  2-3.     The  variables 
most  affected  by  missing  da ua  are  the  previous  child  care 
variables  CNTRCARE  and  NOTCCARE.     The^e  account  for  for 
almost  no  var  ance  in  either  GP^I  or  GPPVT.     When  CNTRCARE 
and  NOTCCARE  were  excluded,  sample  size  rose  to  N  =  687. 
Results  are  shown  in  Tables  '^-2B  and  2-3B. 
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Table  2-1 

BACKGROUND  VARIABXfeS  ON  DATA  FILES 


Child  Level 

Computer 

Designation  Definition 

RACE*  Race  1=B  2=W 

SEX*  Sex     1=M  2=F 

AGE*  Age  as  of  January  1,  1977 

TINCENT  Time  in  center  as  of  January  1,  1977 

NFOLKS*  Number  of  people  at  home 

NADULT*  Number  adults  at  home 

NLT12*  Number  of  children  less  than  12  at  home 

NSIBLING*  Number  of  siblings 

INCOMEC*  Income  scale 

MOTHRED*  Mother's  education  (years  of  education) 

CNTRCARE*  Months  of  previous  center  care 

NOTCCARE*  Months  of  preschool  non-center  child  care 


Neighborhood  Level 

CENSUS33  Percent  of  Families  Feb.,  1969  income  was 

less  than  the  poverty  level 
CENSUS03  Persons  per  household 

CENSUS21    Females  in  labor  force 

TRACT9  Fraction  pop.  in  same  house  as  1965 


Center  Level 

FRWHITE  Fraction  white  (from  RACE) 

FRMALE  Fraction  male  (from  SEX) 

AGEMEAN  Mean  age  (from  AGE) 

AGEMAX  Maximum  age  in  center 

AGEMIN  Minimum  age  in  center 

NPEOPLE  Mean  persons  at  home  (from  NFOLKS) 

NADULTS  Mean  adults  at  home  (from  NADULT) 

NLT12H  Mean  children  less  than  12  at  home 

(from  NLT12) 

NSIBS  Mean  siblings  (from  NSIBLING) 

INCOME  Mean  family  income  (scaled)    (from  INCOMEC) 

CENTER  Mean  months  previous  center  care 

(from  CNTRCARE) 
NOTCNTR  Mean  months  previous  non-center  care 

(from  NOTCCARE) 

*Also  present  on  Center  Aggregated  File 
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Table  2-2A 


RESULTS  OF  STEPWISE  REGRESSIONS.  THTrn  rn,rr, 
GPSI  ON  CHILD  BACKnRniiMn  vAPTAPfp^ 
n=489 


Variable 


Steg  Entered  Removed 

^  1  NPOLKS 

2  NADULT 

3  INCOMEC 

4  AGE 

5  CNTRCARE 

6  TINCENT 

7  SEX 

8  MOTHRED 

9  NSIBLING 

10  RACE 

11  NOTCCARE 

12  NLT12 


R  Square 

P  to 


!r  or  Remove 

Significance 

R  Square 

Change 

5.35312 

.01087 

.01087 

.10427 

1.63924 

A  1  i  A  A 

.01420 

.00333 

.09760 

1.87832 

Ml 

.01800 

.00380 

-.02121 

1.33499 

.248 

.02070 

.00270 

.05228 

1.17594 

.279 

.02308 

.00238 

-.04881 

.75486 

.386 

.02461 

.00153 

-.03342 

.17244 

.678 

.02496 

.00035 

.01983 

.16131 

.688 

.02528 

.00033 

-.01208 

.12314 

.726 

.02553 

.00025 

.05170 

.09678 

.756 

.02573 

.00020 

-.00201 

.07763 

.781 

.02589 

.00016 

.00206 

.01449 

*904 

.02692 

.00003 

.05773 

ERIC 
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Table  2-2B 


GPSI  AGAINST  .10  REGRESSORS 
(CNTRCARE;  NOTCCARE  EXCLUDED) 
n=687 


R  Sauare 

tep 

Entered  Removed 

F  to 
Enter  or  Remove 

Signuicance 

R  square 

cnange 

Simple  ] 

NFOLKS 

2.01111 

.257 

.00293 

.00293 

.04510 

INCOMEC 

.78145 

.477 

.00407 

.00114 

-.03279 

NADULT 

.60564 

.437 

.00495 

.00088 

.03521 

RACE 

.26220 

.609 

.00566 

.00023 

-.03340 

AGE 

.22325 

.637 

.00566 

.00003 

-.01682 

SEX 

.13959 

.709 

.00586 

.00020 

-.01303 

MOTHRED 

.08839 

.766 

.00599 

.00013 

-.01462 

8 

NSIBLING 

.04807 

.827 

.00606 

.00007 

-.03331 

9 

NLT12 

.04695 

.829 

.00613 

.00007 

.03676 

10 

TINCENT 

.04209 

.838 

.00619 

.00006 

-.00759 

ERJC 


Table  2-3A 

RESULTS  OF  STEPWISE  REGRESSIONS.  CHILD  LEVRr. 
GPPVT  ON  CHILD  BACKGROUND  VARIABLES 
n=489 

(Two  var.tables  were  not  entered  by  SPSS.) 

Variable 

F  to 


R  Square 


Step  Entered  Removed 

1  NFOLKS 

2  NADULT 

3  INCOMEC 

4  AGE 

5  CNTRCARE 

6  TINCENT 

7  SEX 

8  MOTHRED 

9  NSIBLING 
10  RACE 

U  NOTCCARE 

12  NLT12 


ir  or  Remove 

Significance 

R  Square 

Change 

Simple  R 

5.35312 

.021 

.01087 

.01087 

.10427 

1.63924 

.201 

.01420 

.00333 

.09760 

1.87832 

.171 

.01800 

.00380 

-.02121 

1.33499 

*148 

.02070 

.00270 

.05228 

1.17594 

.279 

.02308 

.00238 

-.04881 

.75486 

.386 

.02461 

.00153 

-.03342 

.17244 

.678 

.02496 

.00035 

.01983 

.16131 

.688 

.02528 

.00033 

-.01208 

.12314 

.726 

.02553 

.00025 

.05170 

.09678 

.756 

.02573 

.00020 

-.00201 

.07763 

.781 

.02589 

.00016 

.00206 

0144- 

.904 

.02692 

.00003 

.05773 
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J,  Table  2-3B 


GPPVT  AGAINST  10  REGRESSORS 
n=687 

(One  variable  was  not  entered  by  SPSS.) 

Var^ab^e   R  Square  

F  cci 

5£iE    ^"tered     Renvo/ed    Enter  or  Remove    Significance    R  Square  Change  simple  R 


1 

RACE 

■^0.23584 

.001 

.01472 

.01472 

.12134 

2 

NADULT 

5.06676 

.025 

.02197 

.00724 

.09617 

3 

NFOLKS 

1.12892 

.288 

.02358 

.00161 

-.00655 

4 

NSIBLING 

1.39050 

.239 

.25570 

.00199 

-.00438 

5 

TINCENT 

.63652 

.361 

.02676 

.00120 

.03190 

6 

INCOMEC 

.45946 

.498 

.02742 

.00066 

.06136 

7 

MOTHRED 

.11479 

.735 

.02759 

.00066 

.06136 

8 

NLT12 

.04062 

.840 

.02764 

.00006 

-.05374 

9 

AGE 

.01029 

.919 

.02766 

.00001 

-.00082 

2es 


Results  of  the  multiple  regression  showed  that  for 
the  PSI  only  .006  of  the  variance  is  accounted  for  by  10 
covariables,  and  none  of  them  are  significant.     For  the 
PPVT,  10  variables  account  for  .028  of  the  variance.  There 
are  two  significant  regressors:     RACE  and  NADULT,  accounting 
together  for  .02  of  the  variance,     it  was  decided  to  retain 
RACE  as  a  covariable  but  not  NADULT.    The  latter  accounted 
for  only  .007  of  the  variance  which  is  not  of  practical 
significance,    .it  was  determined  (see  below)  that  the 
center-level  effect  is  much  larger  than  can  be  accounted  for 
by  any  child-level  covariables.     Thus,  there  is  little 
sensitivity  of  any  of  the  conclusions  to  the  details  of 
child  level  background  variable  adjustments. 
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CHAPTER  THREE;     AGGREGATION  AND  THE  UNIT  OF  ANALYSIS* 


Introduction 

Choice  of  the  appropriate  unit  of  analysis  is  a 
key  decision  in  any  investigation  involving  hierarchical 
levels  of  data*     In  educational  evaluation,  data  are  usually 
collected  in  an  explicit  hierarchy;  children  are  nested 
within  classes,  classes  within  schools,  schools  within 
school  districts.     While  evaluators  want  to  focus  on  the 
response  of  individual  children  to  educational  treatments, 
the  treatments  are  usually  applied  at  class,  school,  or 
school  district  level*     The  question  of  individual  response 
to  treatment  is  often  reformulated  in  the  question  of 
aggregate  (class,  school,  or  district)   response.    While  the 
relation  between  individual  and  aggregate  models  at  first 
appears  to  be  straightforward,  it  is,  in  fact,  extremely 
complicated.     Decisions  about  the  unit  of  analysis  (UOA)  are 
difficult  and  often  affect  the  conclusions.     Answers  to 
specific  questions  are  quite  likely  to  be  different  at 
different  levels  of  analysis;  conduct  of  multiple  level 
analyses  may,  therefore,  merely  postpone  the  decision  until 
the  results  have  been  seen.     That  approach  should  be  rejected 
since  too  much  subjective  bias  is  likely  to  enter  in  such  £ 
poster ior i  decision  making.     This  section  presents  some  of 
the  technical  and  practical  considerations  that  entered  the 
docision-making  process  in  the  National  Day  Care  Study. 

The  problems  of  aggregation  and  disaggregation 
received  only  passing  attention  (Gehlke  and  Biehel ,  1934; 
Yule  and  Kendall,  1950)   until  Robinson's  (1950)  classic 
paper  on  the  "ecolog ical  fallacy" .     Robinson  showed  that 
not  only  the  strength  but  the  direction  of  relationships  may 
differ  at  the  individual  and  aggregate  levels.  Sociologists 


♦This  section  is  an  adaptation  of  Singer  and  Goodrich  (1979). 


were  cautioned  against  Interpreting  "ecological  correlations" 
i.e.,  those  at  aggregate  level,  as  measures  of  individual- 
level  correlations.     Subsequent  debate,  predominantly  in 
economics,  sociology,  and  political  science,  focused  upon 
disaggregation,  i.e.,  the  use  of  aggegate  data  to  draw 
inferences  about  individuals  (see  Goodman,  1953;  1959;  and 
Duncan  and  Davis,  1953).     Then  in  the  early  1970s,  the 
topic  gained  popularity  in  educational  research  with  works 
by  Hannan  (1971),  Hanftan  and  Burstcin  (1974),  and  Cronbach 
(1976).     However,  as  Cronbach  (1976)  and  Knapp  (1977)  point 
out,  no  adequate  solution  has  been  reached  for  determining 
at  whfit  level  (or  levels)  analysis  should  be  carried  out. 

Since  the  literature  offered  no  definitive  approach 
the  research  staff  of  the  National  Day  Care  Study  (NDCS) 
considered  the  problem  nearly  from  scratch.     This  paper 
outlines  how  the  UOA  was  selected  through  the  considerations 
of  a  combination  of  practical,  substantive,  and  methodolog- 
ical issues.    We  will  discuss  a  mathematical  formulation  of 
the  problem  where  the  effects  of  aggregation  on  regression 
coefficients  and  hypothesis  testing  can  be  presented,  and 
conclude  with  a  presentation  of  the  decisions  actually  made 
and  the  justifications  for  them. 

In  the  NDCS,  data  were  collected  at  three  levels; 
child,  class/lead  teacher  and  center.*    Observations  of 
child  behavior,  scores  on  two  standardized  tests  (the 
Caldwell  Pre-School  Inventory  and  Peabody  Picture  Vocabulary 
Test)  and  information  on  family  background  characteristics 
were  gathered  at  the  child  level.    At  the  caregiver  level, 
background  information  was  collected  and  observations  of 
behavior  were  made.    Measures  of  classroom  composition 
(group  size,  number  of  caregivers,  and  the  resulting  staff/ 


*Lead  teacher  and  class  level  are  virtually  identical;  with 
infrequent  exceptions,  only  one  lead  teacher  was  asigned  to 
a  specific  class. 
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child  ratio)  were  calculated  as  averages  of  repeated  observa- 
tions in  classrooms.     Finally,  data  on  auspices,  program 
philosophy  and  orientation,  and  director  qualifications  were 
collected  at  the  center  level.     A  wide  variety  of  analyses 
were  to  be  conducted  where,   in  each  instance,   the  data  had 
to  be  aggregated  or  disaggregated  to  the  selected  UOA. 
Thus,   a  class-level  analysis  required  both  disaggregation  of 
center-level  variables  and  aggregation  of  child  level 
variables  that  entered  the  analysis.     In  this  paper  we 
discuss  the  choices  made  for  three  types  of  studies  involving 
(1)  Child  Pre-School  Inventory  (PSI)  and  Peabody  Picture 
Vocabulary  Test  (PPVT)  growth,    (2)  caregiver  behavior, 
and  (3)  child  behavior  as  dependent  variables.     All  three 
studies  used  regression  (with  covariables)  as  the  principle 
analytic  tool. 

We  did  not  consider  aggregating  PSI  and  PPVT  data 
to  the  class  level  because  the  composition  of  specific 
classes  within  a  given  center  often  changed  dramatically 
over  the  course  of  the  day  care  year.*    Limiting  the 
analytic  sample  to  children  who  remained  in  the  same  class 
from  fall  to  spring  would  severely  reduce  the  sample — by  25 
percent.     Moreover,   the  stability  of  the  classroom  unit 
varied  significantly  from  site  to  site  and  center  to  center; 
as  a  result,  the  sample  would  be  concentrated  in  more  stable 
sites  and  centers.     Hence,  only  two  alternatives  were 
considered  for  child  test  data — child  and  center  levels. 
Caregiver  behavior  variables  could  be  analyzed  at  person/class 
or  center  level.     Child  behavior  could  be  studied  at  any  of 
the  three  levels.     The  final  decisions  were  to  analyze 
caregiver  behavior  at  the  person/class  level,   child  behavior 
at  the  class  level  and  test  scores  at  the  center  level*  In 
the  next  section,   the  problem  is  set  up  mathematically  rjnd 

♦Reorganization  of  classes  as  a  function  of  shifting  enroll- 
ment is  very  common  in  day  care,   especially  in  for-profit 
centers  which  expand  and  contract  with  demand. 
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the  reasoning  behind  the  PSI/PPVT  test  score  decision  is 
presente..l„ 

Mathematical  Formulation 

To  simplify  the  mathematical  development,  we  will 
consider  only  two  levels  which  we  will  call  the  child  (or 
individual)  and  the  class.     The  results  can  be  generalized 
to  multiple-level  data.     First  we  state  some  easily  demon- 
strated statistical  facts  about  two-level  (child  and  class) 
hierarchical  regression  models  in  order  to  demystify  some 
arguments  often  made.     These  facts  are: 

•  Class-level  and  child-level  estimates  of  the 
Srov?i^H%K^  effects  are  identical 

niffnJ^^  """^^^f         homologous  (in  a  sense  to 
be  defined),  and  that  class-level  effects  estimates 

the  cJii'ST'^!?'^^-  t°  homologous! 

the  chxld-level  regression  model  must  include 

aggregate  "ecological-  effects.     All  other 

variables  must  also  occur  in  both  models. 

•  ^h?i"^"  r^^^'f^  child-weighted, 
child-  and  class-level  estimates  of  global  class 
nnfho      converge  to  the  same  (true)  values  as  the 
fnr^r        Classes  tends  to  infinity,  i.e.,  both 
forms  of  estimation  are  consistent.     For  reasonably 
i?e?d  ff™?^"  Of  classes,  child  and  class  models  ^ 
yield  similar  but  not  identical  results.  Serious 
discrepancies  indicate  that  the  models  are  not 
homologous,  i-e-,  they  are  specified  differently, 
often  m  some  subtle  way. 

•  Even  when  effects  estimates  are  identical  at  the 
two  levels,  hypothesis  tests  yield  different 
l^IiiKh"^^"  intreacl..ss  correlation  effects  exist, 
in  which  case,  the  individual-level  test  is 
biased,  and  class-level  hypothesis  tests  should  be 
conducted. 
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•    There  is  no  serious  diminution  in  statistical 
power  incurred  by  aggregation  to  class  level 
despite  loss  of  degrees  of  freedom.     (The  decresae 
in  degrees  of  freedom  in  the  denominator  under 
aggregation  is  approximately  compensated  for  by 
the  decrease  of  error  variance  obtained  by  taking 
means. ) 

In  multiple  hierarchical  models,  these  facts  argue 
for  aggregation  to  the  highest  level  for  which  significant 
intra-level  correlation  effects  exist.     Effects  sizes  can  be 
calculated  at  lower  levels  if  hypothesis  tests  are  not 
believed  and  models  are  homologous.     We  will  prove  the  first 
three  assertions  in  this  paper. 

Suppose  that  a  study  has  been  conducted  to  analyze 
the  effect  of  a  classroom  variable  on  children's  school 
performance.     Then  three  types  of  variables  exist.  Child- 
level  variables,   (e.g.,  race  or  test  score)  are  attached  to 
specific  children.     Aggregate  variables  are  classroom-level 
averages  of  child-level  measures  (e.g.,   fraction  Black  or 
average  test  score) .     Global  (class-level)  variables  describe 
class  level  characteristics  (e.g. ,  educational  treatment, 
class  size,   and  staff /child  ratio).     Class-level,  analyses 
involve  global  variables  and  aggregate  variables  only. 
Child-level  analyses  can  involve  all  three  types  of  variables. 

Let  us  adopt  the  following  notation: 

dependent  child-level  variables  for  child 
i  within  class  j   (i  =  l,  2,  n.;  j=s 

1,   2,    . . . ,  my   En .  =  N) ,  ^ 

j 

n^  ^         .  =  associated  aggregate  dependent 
j     i       '         class-level  variable. 
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^ii  ~  niatrix  of  independent 

child-level  variables  for 
child  i  within  class  j, 
including  interactions  as 
distinct  components , 


Z    .  = 


j  ~  ^       .  =  matrix  of  aggregate  variables, 

j     i  including  child-level  inter- 

action components. 


X 


.  =  the  (9x1)  vector  of  global  (class 
level)  variables  for  "lass  j. 


.  =  random  error  assoc   a*  r 

with  child  i  withii*     ^  ^bs  j,  and 


f .  =  random  error  associated  with 
^      class  j. 


With  this  notation,  we  assume  the  following  "true" 
child-level  linear  mcdel: 

Y.  .  =  AZ,.  +  BX.  +  CZ^ .  +  e.  .  +  f .   .  (3-I) 

where  sample  means  of  all  variables  have  been  corrected  to 

zero.     Both  e^^  and  f ^  are  assumed  to  be  mutually  uncor- 

related  zero-mean  random  variables  with  variances 
2 

and  V     respectively.     Model  (l)  is  the  most  general 
linear  model  that  can  be  based  on  independent  variables  of 
the  types  discussed  above.     Notice  that  both  Z. .  and  its 
aggregate  Z^  are  entered. 

Two  types  of  effects  are  included  in  the  above 
model:     (a)   fixed  effects  (involving  A,  B  and  C)  attributable 
to  specific  child-  and  class-level  variables?  and  (b)  random 
effects  (e^j  and  fj),  representing  unpredictable  effects 
at  both  levels.     This  model  combines  notions  of  ordinary 
regression  (fixed  effects)  and  variance  components  analysis 
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(random  effects),  and  is  a  version  of  the  "mixed  model"  (see 
'Graybill,  1961).     Econometricians  term  such  models  "error 
components  regressions,"   (see  e.g.,  Arora,   1973).     When  v ^  =  0, 
the  model  reduces  to  an  ordinary  regression.     TTie  disaggregated 
aggregate  variable  Z^,  is  essential  in  the  model;  it  repre- 
sents class  ecological  effects  on  the  individual  child. 

Using  ordinary  least  squares  to  estimate  the 
coefficients  A,   B  and  C  in  (3-1)   is  equivalent  to  minimizing 
the  residual  sum  of  squares: 

RSS  =       Z     (Y   .  -  AZ. .  -  BX.  -  CZ    .)^,  (3-2) 
i,j  ^ 

which  can  be  decomposed  into    '^ild  and  class  components: 

^S^class  =     ]  "jt^Y.j  -   (A  +  j  "  SXj^^'  (3-4) 

where  RSS  =  RSS  ,  . , ^  +  RSS  , 

child  class 

This  decomposition  can  be  reparameterized  by  recog- 
nizing that  the  sum  (A  +  C)  in  (3-4)  is  a  free  parameter,  and 
hence  may  be  set  equal  to  a  new  independent  free  parameter  D. 
Then  (3-3)  and  (3-4)  contain  no  common  parameters. 

Equation  (3-1)  can  be  directly  aggregated  to  obtain 
the  homologous  (Hannan,  1971)  class  level  model, 

where:  Y   .  =  DZ    .  +  BX-  +  (e   .  +  f .)  (3-5) 

Intraclass  correlations  of  residuals  (e^.  +  f.)  present 
in  (3-1)  are  removed  by  aggregation,   i.e.,  random  child 
effects  and  class  effects  become  confounded.     The  child- 
weighted  residual  sum  of  squares  for  (3-5)  is 
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I  n  [Y      -  DZ       -  BX.]2, 
j     J     •  J  •  J  3 

identical  to  RSS^^^^^  from  the  child  model,     since  RSS  . 
and  RSS^^^gg  contain  no  common  parameters,  rss  is  minimized 
by  independently  minimizing  RSS^^.^^  and  HSS^^^^^      The  result- 
ing estimates  (A,  B,  D) ,  can  be  used  to  calculate      =      - 'X. 
The  estimate  B  obtained  from  (3-2)  is  identical  to  that  obtained 
by  minimizing  the  child-weighted  class-level  residual  sum-of- 
squares   (3-4),   proving  the  first  assertion.     if  the  class- 
level  analysis  is  not  child-weighted,   child-  and  class-level 
estimates  of  B  differ  but,  as  the  number  of  classes  becomes 
larger,   they  converge  to  the  same  values. 

If  the  "ecological  term"  CZ  ..  had  been  omitted 
from  (3-2),   then  RSS^^^.^^  and  RSS^^^^*  would  no  longer 
be  independent.     Class  and  child  level  estimates  of  B  would 
differ  because  of  this  difference  in  specif ication— ecological 
effects  are  present  in  the  class-level  model  but  not  in  the 
child-level  model.     This  is  because  the  effects  of  Z. .  and 
Z.  (child-level  covariable  and  the  associated  ecological 
measure)  are  confounded  at  the  class  level.     At  the  higher 
level,   for  example,   it  is  impossible  to  separate  the  possibly 
differential  effects  attributable  to  the  race  of  an  individual 
child  and  the  racial  composition  of  the  class.  Although 
estimates  for  global  class  effects  do  not  differ  in  child 
and  weighted  class-level  analyses,   child-level  analyses  are 
more  informative  about  the  process  as  a  whole.  However, 
coefficients  for  global  variables,   the  primary  focus  of  NDCS 
investigations,  are  estimated  most  economically,  and  with  no 
difference  in  outcome,  in  weighted  class-level  analyses. 

In  contrast,  hypothesis  tests  at  child  and  class 
levels  obtained  from  regression  packages  such  as  SPSS,   BMD  and 
SAS  are  quite  different,   even  if  class-level  regressions  are 
appropriately  weighted.     In  fact,  we  will  show  that  (a) 
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child-level  hypothesis  tests  for  the  significance  of  global 
variables  are  usually  not  appropriate,   and  (b)  aggregate- 
level  weights  that  permit  valid  hypothesis  testing  can  be 
constructed. 


Hypothesis  Tests  at  Child  and  Weighted-Center  Levels 

Hypothesis  tests  for  regression  coefficients 
involve  F-statistics  constructed  as  ratios  of  scaled  chi- 
square  statistics.     Implicit  in  these  tests  are  possibly 
mistaken  distributional  assumptions.     As  a  result,  routinely 
constructed  tests  of  the  significance  of  coefficients 
often  yield  incorrect  rejection  regions  because  the  sums-of- 
squares  used  are  not  distributed  as  chi-square,   even  when 
residuals  have  normal  distributions. 


It  is  easily  shown  that,  subject  to  normality 

conditions,   RSS  ,         is  distributed  as 

2  child  n-m-p 

where  o    is  the  child  component  of  residual  variance  and 

p  is  the  number  of  parameters  in  A,   i.e.  the  number  of 

distinct  child-level  covariables  entered  into  the  model. 

Let  q  be  the  number  of  components  in  (B,D) .     Then  it  can  be 

shown  (See  appendix)  that  RSS  ,         is  distributed  as  the 

class 

sum  of  squares 

where  the  W^,   l£k£m-q,  are  identically  independently 
distributed  (I.I.D.)  normal  random  variables  with  zero  mean 
and  unit  variance  (N(0,1)),  and  l£k£m-q,   are  the  non-zero 

eigenvalues  of 

1/2  1/2 
2:       (I-H)  Z 


Z  is  the  diagonal  matrix 

2  2       2  2  2  2 

diag  (a    +n,   v,a    +n^v,...,  a  +n^v), 
±                    z  m 
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and  H  is  the  "  Z-weighted  hat  matrix" 


In  this  form  X  is  the  mxg  matrix  of  global  classroom  vari- 

ables  assembled  froki  x    v  v        t±.  , 

£iro..i  Aj^fX^f  X^.     It  can  be  seen 

that  H  has  rank  q  and  is  idempotent.     Therefore  (l-H)  is 

an  idempotent  mxm  matrix  of  rank  m-q  . 

In  general,   (3-6)  does  not  have  a  chi-square 
distribution.     Therefore,  RSS^^^^^  and  RSS  are  not  in 
general  distributed  at.  chi-square.     As  a  result,  F-tests 
that  depend  upon  chi-square  distributional  assumptions  are 
invalid.     To  construct  valid  exact  tests,  it  VA3uld  be 
necessary  to  calculate  the  cumulative  distribution  of  (3-6) 
numerically  (imhoff,   1961;  Jensen  and  Solomon,  1972). 
However,   a    and    v     are  not  }<;;iOwn  and  must  be  estimat- 
ed to  perform  the  required  numerical  integration. 

The  form  (3-6)  is  chi-square  if  and  only  if  all 
the  X^=l  or  scaled  chi-square  if  all  the  are  constant, 
•i-his  occurs  for  either  of  the  following  special  cases. 


Condition  A;  =  0    ==>       rss        ^  r? 


class 


a  X 


m-q 


condition  B:     N^=N2=.  .  .=N^=N/M  ==>  RSS^,^^^   (a  ^  ^E^2^^2 

where  m  is  the  total  number  of  classes.     Thus,  if  there  are 
no  random  class-level  effects  (Condition  A),  or  if  all 
classes  are  of  equal  size  (Condition  B),  RSS  is 
distributed  as  scaled  chi-square.  class 

In  order  to  proceed  most  simply  we  will  assume 
that  condition  B  holds,  i.e.  that 


m- 


^^^lasr  +  ^v')  X 


m  m-q* 


Practically  speaking  this  is  a  reasonable  approximation 

whenever  class  sizes  are  not  extremely  uneven.     However,  as 

RSS  ,        may  be  made  chi-square  even  for  unequal  class 
class  ^  ^ 

sizes  by  appropriate  we',  hting.     This  would  ordinarily  not 

be  necessarv.     The  more  ;rs. 'lous  problem  is  the  distribution 

of  RSS.     Even  if  RSS  ,  ^  RSS  are  separately 

class  child  — ^  ^ 

chi-square,   the  mixture  RSi-       RSS  ,         +  RSS  ,         is  not. 

class  child 

In  fact  the  distribution  of 


n-m-p  m  m-q'  ^  ' 

is  not  chi  -     ^are  unless  the  cla&ri        *  *J   . -indom  effects 
variance  ^.ero.     We  may  not  ct*  i-un.*^  ^;.\i}t 

RSS     o  '    (    "  +  X        )   =^         ^  ' 

n-m-p        m-q  u-q 


unless  the  intrt>ir  -iSJv  correlation  of  cl^fis  lavel  residuals 
satisfies  the  co;i  iri':,'^icn  relation 


where  N/m  is  the  average  number  of  children  per  class.  Thus 
even  small  intraclass  correlations  make  the  chi-square 
assumption  for  RSS  untenable  when  N/m  is  large.* 

Child-level  hypothesis  tests  are  thus  usually 

invalid.     The  conventional  child-level  F-test  is  biased 

? 

(for  v'>o)   in  the  sevise  that  when  the  null  hypothesis  is 
true,   it  i?.  nevertheless  rejected  with  pro?;ability  on^^  as 
sariple  tends  to  infinity.     These  results  are  of  prac  leal 
consequence.     In  the  NDCS,  data  were  analyzed  ( experin.antally) 
both  at  child  and  child-weighted  center  levels,  using 

*Even  when  v -  0,  problems  ras.y  occur.     For  example,  if 
there  is  specj.f ication  error  in  the  child'-level  model. 
Residual  SS  is  not  distributed  a    chi-sqn^re  but  rather  as 
a  mixture  similar  to  that  obtained  when     "  ^0.     In  this 
situation,  hypothesis  tssts  for  B  are  a;.s>o  inv  ^lid. 
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homologous  models.     Center-level  effects  estimates  were 
identical  up  to  round-   ff  error,  but  many  more  effects  were 
"significant"  at  child  than  at  center  level.     The  difference, 
mathematically  and  experimentally,  results  from  too  frequent 
rejection  of  the  null  hypothesis.     It  is  not  due  to  greater 
statist! '-al  power  but  to  test  bias. 

The  mathematical  arguments  cited  above  indicate 
that  one  should  aggregate  to  the  lowest  level  for  which 
intraclass  correlation  effects  cannot  reasonably  be  assumed 
to  vanish.     In  doing  so  one  gains  validity  of  hypothesis 
tests  without  losing  substantial  statistical  power,  t  .it 
loses  detail  about  effects  that  were  aggregated  over.  Note, 
however,  that  the  magnitude  of  child-level  effects  can  be 
estimated  even  if  hypothesis  tests  are  invalid. 

Tlie  nex-^  chapter  describes  the  actual  calculation 
of  various  components  neeJed  to  apply  the  theory  described 
above.     It  was  deteririnerl  in  analyses  of  center-level  (v^) 
and  child-level  (a^)   components  of  variance  of  residuals 
that,  in  the  notation  given  earlier,  ^  ^2  ^^^^ 

the  same  order  of  magr   tude.    -,o  that  analyses  at  child  level 
;*ould  yield  biased  hypothesis  tf.  ts.     Therefore,  despite 
possible  loss  of  child-level  detail,   the  decision  to  conduct 
center  level  analysis  was  considered  mandatory. 

Summary 

We  have  presented  some  of  the  considerations  which 
entered  into  the  process  c     selecting  analytic  units   -n  the 
NDCS.     Synthesis  of  thi^  information  led  to  the  decision  to 
analyze  caregiver  behavior  at  the  person-level,   child  bel.avior 
at  the  class  level  and  test  scores  at  the. center  level. 

The  decision  to  anr'lyze  test  scores  at  .  -^nter 
level  has  already  been  euppcrted.     The  \<  -\  of  general- 
izability  of  staff-child  ratio  and  groun  size  at  the 
child  level  provided  further  weight  to  .he  decision. 
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Child  behavior  could  not  be  analyzed  at  the 
child  level  because  results  presented  above  showed  that 
hypothesis  tests  were  likely  to  be  biased.  Variance 
components  analyses  indicated  that  NDCS  child  behavior 
data  were  less  well  characterized  as  measures  of  child 
traits  than  as  measures  of  overall  classroom  (or  center) 
processes.     The  choice  between  class  and  center  level  was 
made  on  the  basis  of  greater  detail  at  class  level,  i.e. 
the  ability  to  illuminate  differences  from  class  to  class 
within  center. 

Caregiver  behavior  was  investigated  at  the  person 
level,  which  is  essentially  identical  to  class  level  since 
there  was  usually  only  one  lead  teacher  per  class.  The 
greater  generalizability  of  dependent  and  independent 
measures  at  the  class/teacher  level  informed  the  decision  to 
conduct  teacher-level  analyses. 

These  decisions  were  an  important  part  of  the 
analytic  framework  for  NDCS  analyses.     Central  to  this 
approach,  however,  was  the  fact  that  the  focus  was  on 
estimating  the  effects  of  staff-child  ratio  and  group  size 
on  caregiver  and  child  outcomes,  not  upon  the  relationships 
between  person  or  aggregate-level  variables  and  these  dependent 
measures.     If  the  emphasis  was  on  estimating  the  relationship 
between  a  child's  race,   the  ethnic  composition  of  a  class 
and  child  test  scores,  analyses  might  have  been  pursued  at 
the  child  level,   despite  the  technical  difficulties  cited. 
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CHAPTER  FOUR;     CALCULATIKG  CEMTF ^  AND  CHILD  COMPONENTS  OF 
VARIAN'r^  

In  the  previous  chapter,  the  problem  of  selecting 
a  unit  of  analysis  (level  oi  aggregation)  was  related  to 
determination  of  the  relative  magnitude  of  child-  and  center- 
level  variance  components.     This  chapter  presents  the 
analysis  that  was  undertaken  in  order  to  determine  these 
variance  components.     The  primary  analytical  model  is  the 
randcxn  effects  ANOVA  (see  Graybill's  (1961)   "Model  V", 
p. 1^51-354).     The  results  were  used  to  calculate  the  generali- 
zability  of  center-level  means,  to  assist  in  the  interpreta- 
tion of  aggregated  center-level  models  of  day  care  effects, 
and  to  test  for  the  appropriate  unit  of  analysis,  as  discussed 
in  Chapter  Three. 

The  model  presented  in  Chapter  3  (Equation  (3-1)) 
is  sometimes  called  an  "error  components  regression"  model 
because  the  conventional  error  term  is  split  into  two 
components  representing  child-  and  center-level  errors.  The 
analysis  of  the  error  components  model  is  made  clearer  if  we 
group  certain  terms  from  Equation  3-1.     Recall  that  the 
grand  mean  has  been  subtracted  out  and  that  all  quantities 
have  zero  means. 

The  terras  with  a  single  center  index  j  are  grouped 
together  as 


a.  =  EX.  +  CZ  .,  +  f .  , 

representing  the  total  center  effect.  The  doubly  indexed 
terras  are  grouped  as 


"ij  =  ^^ij  ^  -ij 


The  resulting  mathematical  model  is 
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where 


=  cc.  +  w,.  (4-1) 

i    =  center  index;   1  <.  j  £  m 
m    =  number  of  centers 


n 


i    =  child  index,  nested  within  center;  1  £  i  jc  n. 

=  number  of  children  in  center  j;    En.  =  N 

=  effect  of  center  j 

W^.      effect  of  child  i  within  center  :  cionfounded 
with  measurement  error 


In  the  analysis        and  W^j  are  independent  ran- 
dom variables  with  zero  mean  and  variances  and 
respectively.     For  purposes  of  hypothesis  testing,  all 
random  variables  are  assumed  to  be  normally  distributed,  but 
this  assumption  is  not  required  for  point  estimations. 


Table  4-1  gives  the  ANOVA  table  for  this  design. 
EMS  estimators  for        and  c?     are  obtained  from  the  table 
by  matching  mean  and  expected  mean  squares.     The  explicit 
formulas  are: 


n  —  E  n. 

1 


(4-2) 
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Table  4-1 


ANOVA  TABLE  FOR  CENTER/CHILD  DESIGN 


DF  SS 


MS  EMS 


Total 

Grand  Mean 


1  .I.y?. 


,2  _ 


Centers  m-1       SS    =     Z   (y      -y..)2  „g  "    ~  ^  "l 

^      ^'J       O  c        oj  n{m-l) 

Children  n-m      SS,    =  .^.(v.     _  v     )^  mg  «2 


This  design  allows  simple  calculation  of  the  generalizability 
of  center  means.  Since 


„2        r.  2 


Eil.   (Y  ..  -  Y..)-  =  (n._i)a2  +  ,2^  (4.3^ 


the  center  level  sum-of- squares  includes  variance  attributable 
both  to  center  effects  (term  involving  a2)  and  to  aggregated 
child-effects  and  error  (term  involving  aj) •     The  fraction 
attributable  to  center  effects  is  defined  as  the  generaliza- 
bility of  the  center  mean  and  is  given  by 

n^  -   Zn^  2 

P  =   n  ^ 

 2  2—  '  ^^-^^ 

2         n^  -    Zn2  , 

(m-l)%    +  ■  J.  °a 
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Thus  an  estimate  of  p  is  given  by  the  simple  formula 


MS    -  MS,^ 

^  -        MS^  '  (4-5) 

where  the  terms  on  the  right  are  defined  in  Table  4-1. 
Fixed  Effect 

Suppose  that  an  ordinary  (fixed  effect)  regres- 
sion is  conducted  in  which  each  center  is  represented  by  a 

separate  (dummy)  variable.     The  variance  explained  by  such  a 

2 

regression  is  SS^  and  the  R    achieved  is  given  by  SS^/(SS^  + 
SS^) .     The  R    includes  all  variance  explained  by  center  sample 
means  and  thus  includes  capitalization  on  chance  fluctuations 
of  aggregated  error  and  child  effects.     It  is  thus  an 
over-estimate  of  the  explanatory  power  of  center-level 
causes.     The  analysis  given  so  far,  however,   shows  that  the 
fraction 

SS^  (MS^  -  MS^) 

ss^  +  ss,^  -  ss^  +  ss^  ' 


which  we  will  call  the  "corrected  R        is  an  estimate 
of  the  fraction  of  variance  actually  associated  with  center- 
level  effects,  while  (m  -  1)   (MS    -  MS,  )  is  an  estimate 

c  k 

of  the  total  variance  associated  with  center  effects.  The 
magnitude  of  the  center  effect  in  test  score  points  is  given 
by  the  square  root  of  the  center  component  of  variance, 
i.e. ,  by  . 
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The  calculations  that  have  been  discussed  are  made 
easily  by  performing  an  ordinary  (fixed  effect)  one  way  ANOVA 
classification  of  the  dependent  variable  by  center.  Results 
for  several  dependent  measures  are  given  in  Tables  4-2  and  4-3 • 


Table  4-2 

VARIANCE  COMPONENTS  OF  GENERALIZED 
COGNITIVE  CHANGE  MEASURES  


Measure      Component  DF 


SS 


MS 


Estimated  Root 
Variance  Component 


GPSI 

Center 

56 

1886 

•  5 

33.69 

Child 

854 

10771 

•  9 

12.61 

GPPVT 

Center 

56 

7857 

.9 

140.32 

Child 

801 

47592 

.1 

59.41 

RPPVT 

Center 

56 

7028 

•  6 

125.51 

Child 

740 

43246 

•  0 

58.44 

1 

.14 

3 

.55 

2 

.30 

7 

.70 

2 

.18 

^0) 

7 

.64 

Table  4-3 

COMPUTED  STATISTICS  FROM  VARIANCE  COMPONENTS  ANALYSIS 


GPSI 

GPPVT 

RPPVT 


Fixed 
Effect  R"^ 

.149 
.142 
.140 


Corrected  R^  Significance 


.093 
.082 
.075 


.000 
.000 
.000 


Generalizability 
of  Center  Mean 

.63 
.58 
.53 


The  discussion  in  Chapter  Three  showed  that  the  question 
of  the  appropriate  UOA  revolves  about  the  variance  components 
and  ^     of  the  error  in  the  model  (3-1).     These  components 
can  be  estimated  by  the  approximate  technique  to  be  outlined 
here.     Then,  given  values  for 'o^^  ^^^^2^ 
selected. 
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The  technique  is  as  follows.     It  is  known  from 
regressions  conducted  at  child  and  center  levels  (the  latter 
are  treated  in  Chapter  Six)  that  to  a  reasonable  approximation 
the  coefficients  A  and  C  in  Eq.   (3-1)  are  zero,   so  that  the 
model  simplifies  to 


Y.  .  =  BX.  +  e.  .  +  f, 

13  D         ID  j 

l£i£nj  ,  lljlm, 

2  2  2  2 

where  E  e^^  =  a    and  E  f ^  =  v  .     The  coefficient  vector 

B  in  this  model  can  be  estimated  consistently  either  at 

child  or  (weighted)  center  level.     Then        and        can  be 

determined  by  variance  components  analysis  of  the  residuals 

-    ^^j'     When  the  number  of  components  in  the  vector 

Xj  is  small  compared  to  the  number  of  centers,  there  is  no 

need  to  consider  degrees  of  freedom  used  in  estimating  B, 

and  the  residuals  =  Y^^  -  BX^  can  be  analyzed  directly, 

assuming  that 


r .  .  =  e.  .  +  f . 
ID         ID  D 

2  2 

The  estimates  for  o  and  v  include  specification  error  vari- 
ance at  these  two  levels. 

2  2 

Estimates  of  a     and  v    were  obtained  through 
one-way  analyses  of  variance  as  described  earlier  in  this 
chapter  and  as  shown  in  Table  4-3A. 

Table  4-3A 
COMPONENTS  OF  RESIDUAL  VARIANCE 

Level  GPSI  RPPVT 

Child  (^^)  12.3  59.84 

Center  (v   )  .74  2.63 
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It  was  determined  from  these  figures  (see  Appendix  1)  that 
approximately  optimal  weights  for  center-level  analyses  are 
given  by: 


Weight 
GPSI  (rij^  +  .06)-^ 

RPPVT  (n~^  +  .04)"^ 

Since  average  n.  equals  about  15.  both  terms  of  these 
formulas  are  important.     Neither  weighted  nor  unweighted 
center-level  yield  exactly  appropriate  hypothesis  tests  at 
center  level,  although  neither  would  be  in  severe  error. 
Child-level  tests,  however,   are  totally  invalid  since  the 
residual  sum-of-squares  is  not  distributed  as  chi-square  for 
an^r  choice  of  weights.     Departures  from  chi-square  are 
severe  for  the  values  of        and  estimated. 

Summary 

The  analysis  shows  that  center  effects  must  be 
considered  larae  (1.14  points  on  the  PSI.   2.18  on  the  PPVT). 
compared  to  "normal"  growth.     Mean  growth  (T4  -  T3)  was 
approximately  4.8  points  for  the  PSI.  7.9  points  for  the 
PPVT.   so  that  center  effects  can  be  reexpressed  development- 
ally  as  1.2  months  (PSI)  and  1.4  months  (PPVT).     m  two 
other  studies,  mean  development  rate  was  slower  than  in  the 
NDCS  sample,  viz. 

(1)     For  the  Home  start  National  Evaluation 
Sample,  cross-sectional  data  suggest  a 
growth  rate  of  2-2.5  points  per  6  month 
period  for  the  PSI  32  item  test.  This 
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figure  does  not  include  Home  Start 
Treatment  Effect  since  it  depends 
entirely  on  pretest  data.  Source: 
High/Scope,  1973a  (p.  123),  1973b  (p. 
148),  1974   (Table  IV-47) .     See  Table  4-4. 

(ii)   For  the  Head  Start  Planned  Variation 
Study,  similar  estimates  range  from 
about  1  to  3  points  per  6  month  period. 
See  Table  4-5. 


Center  effects  as  defined  in  this  variance 


components  study  include  all  possible  center  level  effects 
including  aggregated  child  background  effects.  However, 
these  were  found  to  be  negligible  at  the  child  level.  They 
may  still  account  for  variance  at  the  center  level  through 
so-called  ecological  effects.     The  total  center-level  vari- 
ance is  potentially  only  .63   (PSI)  or  .58   (PPVT)  explainable 

through  center-level  regression  model,  through  a  computation 

2 

of  center-mean  generalizabili ty.     Otherwise  put,  (1.14) 
2 

and   (2.18)     are  maximum  center-level  explainable  variances. 
The  fact  that  these  figures  are  developmentally  large  shows 
that  there  are  likely  to  be  highly  significant  regression 
models  at  center  level. 


A  variance  com^^onents  analysis  of  residuals  obtained 


from  center-level  regression  models  (Chapter  Six)   shows  that 
child  level  hypothesis  tests  are  in  serious  error  and 
weighted  center-level  tests  are  approximately  correct. 
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Table  4-4 


PSI32  MEANS  AND  STANDARD  DEVIATIONS  BY  AGE  GROUP: 
FALL  1972,  SRPING  1973  AND  FALL  1973  HOME  START  NATIONAL  EVALUATION* 


Fall  1972  spring  1973 


Fall  1973 


ge  (mos.) 

N 

Mean 

SD 

N 

Mean 

SD 

N 

Mean 

§^ 

34-39 

18 

8.7 

4.1 

3 

9.3 

3.5 

50 

7.4 

3.6 

40-45 

29 

11.2 

5.3 

19 

11.0 

3.7 

113 

8.3 

3.6 

46-51 

44 

13.1 

6.1 

27 

11.0 

4.9 

125 

9.9 

4.3 

52-57 

19 

13.1 

4.5 

37 

13.8 

5.4 

97 

11.8 

4.9 

58-63 

39 

15.1 

6.0 

33 

16.4 

4.8 

33 

13.5 

5.0 

64-69 

17 

17.4 

5.9 

26 

17.8 

6.6 

7 

18.9 

4.6 

70-75 

16 

20.5 

6.3 

10 

21.0 

5.2 

•fligVScope,  1973a  (p.  123) ,  1973b  (p.  148) ,  1974  (Table  IV^47) 
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PSI32  MEANS  AND  S'lA..      *  'ATIONS  BY  AGE  GROUP  AND 

PREVIOUS  PRESCHOOL  SXPEi"  ND  BY  AGE  GROUP  AND  RACE; 

FALL  1971  HEAD  STAR!  :  SD  VARIATION  STUDY 


Without  Previous  Preschool         With  Previous  Preschool 


fe  (mos.) 

N 

Mean 

N 

Mean 

SD 

36-38 

4 

7.8 

4.82 

39-41 

4 

6.8 

1.48 

42-44 

16 

7.6 

3*79 

2 

12.0 

3.00 

45-47 

63 

10.2 

4.65 

6 

13.0 

3.27 

48-50 

207 

10.6 

4.51 

35 

12.1 

5.86 

51-53 

374 

11.2 

4.93 

63 

13.0 

5.31 

54-56 

397 

12.5 

5.02 

57 

13.2 

5.60 

57-59 

368 

13.4 

5.11 

81 

15.0 

5.59 

60-62 

257 

15.9 

5.56 

121 

17.7 

5.61 

63-65 

162 

17  0 

5.40 

99 

17.2 

5.81 

66-68 

165 

17.4 

5.59 

96 

19.7 

5.09 

69-71 

119 

19.9 

5.55 

99 

20.6 

5.82 

72-74 

52 

18.4 

6.12 

40 

22.2 

5.21 

75-77 

2 

5.0 

1.00 

3 

24.7 

1.25 

78-80 

1 

21.0 

2 

8.5 

4.50 
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CHAPTER  FIVE:     FALLIBILITY  OF  DEPENDENT  AND  INDEPENDENT  MEASURES 

In  the  weighted-center-level  effects  analysis,  a 
typical  regression  equation  takes  the  matrix  form 

y  =  XB  +  e  ,  (5_,j 


IS 


where  Y  is  n  x  1,  X  is  n  x  p,  B  is  p  x  1,  e  is  n  x  1,  n 
the  sample  size,   and  p  the  number  of  independent  variables. 
We  assume  that  the  variables  (X,Y)  can  be  measured  only  with 
error.     This  section  presents  the  approach  in  the  NDCS  to 
the  problems  engendered  by  fallibility  of  measures. 

Many  authors  (e.g..  Lord,   1960;  Porter,  1967; 
Campbell  and  Erlebacher,   1970;,   Cronbach  et  al.,  1977) 
have  written  about  effects  of  fallibility  in  independent 
variables  on  the  ANCOVA  strategies  used  to  reduce  the 
bias  that  results  from  the  nonequivalence  of  treatment  and 
comparison  groups.     m  the  present  application,   the  dependent 
measures  do  not  correlate  highly  with  covariables  the 
child  level.     For  the  most  part,   statistical  adjustment 
strategies  were  not  necessary  in  the  cognitive  effects 
analysis.     The  one  covariable  used— race  of  child  at  the 
PPVT  analyses— resulted  only  in  very  small  adjustments  and 
can  be  disregarded  for  all  practical  purposes.  Therefore, 
the  problems  of  bias  usually  encountered  simply  did  not 
occur.     However,   there  were  substantial  effects  on  estimating 
the  magnitude  and  significance  of  center  level  main  effects. 
This  chapter  focuses  on  these  issues. 

In  order  to  deal  with  them,   it  is  necessary 
to  estimate  the  generalizabilities  of  major  variables. 
The  NDCS  used  variance  components  analyses  to  compute 
generalizabilities  for  nearly  all  measures  (see  singer, 
Affholter,   Goodrich,   1978).     Unfortunately  not  all  variables 
were  analyzable  in  this  way  since  specially  designed  "G-Studies" 
(see  Cronbach  et  al..  1972)  had  not  been  performed.     It  was 
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therefore  necessary  to  make  the  estimates  from  the  data  as 
collected  for  the  effects  analyses,   i.e.,  the  data  were 
neither  crossed,  nested  or  balanced.     Nevertheless,  most  of 
the  important  generalizabilities  were  ottain^,d._^via  a"  " 
va r i e ty_o.£__si:^ t is t-ica  1— me thoas^     The  most  important  results 
of  these  analyses  are  presented  in  Table  5-1. 


fallibility  of  the  dependent  measures.     Errors  in  the 
dependent  measures  do  not  result  in  biased  estimates  of 
regression  coefficients  or  the  absolute  amount  of  variance- 
explained.     However,   the  total  variance  of  the  dependent 
measure  is  biased  upward  by  the  factor  l/p,  where  p  is  the 

generalizability.     Thus,   the  fraction  of  variance  explained 

2 

by  the  independent  variables  is  reduced.     The  R  obtained 

in  a  regression  can  be  mujltiplied  by  1/ p  { approximatley  1.7 

for  the  PSI  and  PPVT)  to  obtain  better  estimates  of  the 

fraction  of  true  center-level  variance  explained  by  the 

independent  variables.     For  large  sample  sizes,  the  effective 
2 

ceiling  for  R    equals   P,  or  approximately  60%,  since  even 

a  perfect  model  cannot  explain  error  in  the  independent 

measures.     Because  fallibility  of  the  dependent  measure 
2 

attenuates  R     statistical  power  to  detect  effects  is 
reduced  substantially.     There  is,   unfortunately,   little  that 
can  be  done  to  adjust  for  this  loss  except  to  be  aware  of  it 
in  interpreting  "null"  effects.     Many  of  these  would  not  be 
null  if  the  dependent  variable  had  been  measured  mor^ 
accurately . 


findings  for  attenuation  due  to  fallibility  of  independent 
variables.  Suppose  that  the  model  is  given  by  the  matrix 
equation  (5-1)  and  by  the  measurement  equation 


First  we  consider  the  problems  engendered  by 


On  the  other  hand,   it  is  easy  to  adjust  regression 


Z  = 


X  +  U 


(5-2) 


Table  5-1 

Estimated  Generallzabilities      M.-inr  v^ri^hlr- 


Measure 
GPSI 

GPPVT 

LRATIO 

LKIDS 

LSTAFF 

PREV.  DC. 
EXP. 

SPECIAL- 
IZATION 


Description 

PSI  Generalized 
Change  Score 

PPVT  Generalized 
Change  Score 

Observed  Staff- 
Child  Ratio 

Log  Number  of 
Children 

Log  Number  of  Staff 

Previous  Day  Care 
Experience  of  Staff 

Staff  Specialization 


EDUCATION      Staff  Education 


Generalizabilihy 
.63 

.58 

.88 

.83 

.89 

.34 
.61 

.50 


Source 

Singer,  Affholter, 
Goodrich  (1978)  Ibid. 


Ibid. 


Ibid. 

Unpublished 
calculation 

Unpublished 
calculation 

Crude  estimate 
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where  e  and  U  are  uncorrelated  errors,  independent  of  X,  and 
the  covariance  matrix  of  U  is  given  by 

^    E  (u'u)  =  diag  (a?,  o^,   op  (5-3) 


Then  the  statistic 

B  =  P       (Z  Z)     Z  y 
is  a  consistent  estimator  of  B, 

where 


(5-4) 


P  =  I  -  N  D-A.D  (z'z)""-^  (5-5) 

and 

.-A-=  I  -  diag  (p^,  p^,  P^)  (5-6) 

is  obtained  from  the  generalizabilities  {p;  1  £  i      p}  of  the 
components  of  X.     A  proof  is  provided  by  Fuller  and 
Hidirglou  (1978).     This  formula  is  simpler  in  the  special 
case  where  components  of  Z  are  uncorrelated*  Then 

P  =  diag  (P^,  P^,  P^)  (5-7) 

so  that  disattenuation  of  B  is  accomplished  by  applying 

the  Lord-Porter  disattenuation  separately  to  each  component. 

In  the  more  general  case  the  formula  (5-4)  must  be  used. 
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Consider  the  case  where  there  are  just  two  independent  vari- 
ables in  the  vector  X.     In  this  case  we  can  make  an  explicit 
calculation.     Suppose  that  the  sample  covariance  matrix  is 
given  by 

^    ^  ^  =   E        3  (5-8) 
Then  we  obtain  the  following  for  the  matrix  P. 


P  = 


+  Pi  r(l-p^) 


2 


r(l-p,)  r^  +  p. 


(5-9) 


This  correction  is  then  used  directly  in  Equation  (5-4)  to 
achieve  disattenuated  estimates  for  the  regression  coefficient 
vector  B.     This  Technique  can  of  course  be  generalized  to 
the  case  of  more  than  2  independent  variables. 

We  note,  however,  that  we  can  disregard  terms  in  r 
When  r  is  small,   so  that  in  this  case  (5-5)  can  be  replaced 
by  the  approximate  formula  (5-7).     Examination  of  center-level 
correlations  in  Chapter  6  shows  that  for  the  models  considered 
m  the  effects  analysis,  this  assumption  is  tenable. 
Practically  speaking,   therefore,   regression  coefficients  can 
be  disattenuated  one-by-one,   dividing  by  the  corresponding 
reliability. 

The  fallibility  of  independent  measures  also  atten- 
uates the  absolute  and  relative  amount  of  variance  explained. 
The  disattenuated  variance-explained  is  consistently  estimated 
by  the  form 


(V'Z)P-^  (Z'z)-l  (y'z)',  ,eplaci 


ng  (5-10) 
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the  standard,   uncorrected  version 

(y'z)    (z'z)"^  (y'z)'  (5-11) 

Because  of  the  attenuation  of  variance  explained,   the  power  of 
statistical  hypothesis  tests  for  significance  of  effects  is 
seriously  diminished  in  the  case  of  the  staff-background 
variables  (education,   experience),  where  p  ranges  from  .34 
to  .61.     Classroom  structure  variables  are,  however,  little 
affected . 

Summary 

Generalizabilities  of  major  dependent  and  indepen- 
dent variables  were  computed.     The  generalizability  of  each 
of  the  major  dependent  variables  was  about  .6,  while  that  of 
independent  variables  ranged  from  .34  to  .89.     A  major 
effect  of  the  fallibility  of  these  measures  is  to  attenuate 
the  fraction  of  variance  explained  and  thus  to  reduce 
statistical  poiver  significantly.     A  formula  was  derived  to 
achieve  a  matrix  disattenuation  of  effect  sizes  for  the 
independent  variables.     However,   for  practical  purposes, 
variable-by-variable  (scalar)  disattenuation  by  the  Lord- 
Porter  formula  was  shown  to  be  appropriate.     The  results  of 
these  analyses  were  not  applied  quantitatively  in  the 
actual  analysis  of  effects.     They  were  used,   rather,  to 
provide  a  background  for  the  interpretation  of  effects 
analyses,  presented  in  the  next  chapter. 
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CHAPTER  SIX;     CENTER  LEVEL  COGNITIVE  EFFECTS  ANALYSIS  AND 


VALIDATION  OF  FI ND I NGS 


Description  of  Variables 


The  variables  used  to  analyze  children's  acquisition 
of  cognitive  skills  in  day  care  may  be  divided  into  four  broad 
categories:     dependent  variables,  classroom  structure  vari- 
ables, caregiver  qualifications  variables  and  covariables. 
This  classification  is  illustrated  in  Table  6.1. 

Table  6.1 

VARIABLES  USED  IN  COGNITIVE  ANALYSES 


Dependent 
Variables 

GPSI 

GPPVT 

MGPSI 

MGPPVT 

MDGPSI 

MDGPPVT 

RPPVT 


Classroom 
Structure 
Variables 

NCHILD 

NSTAFF 

RATIO 

LCHILL 

LSTAFF 

LRATIO 


Caregiver 
Qualifications 
Variables 

EDUCATION 
HIGHEST  DEGREE 
SPECIALIZATION 
PREV  DC  EXP. 
CENTER  EXP. 


Covariables 

MOTHER'S  ED 
FRACTION  WHITE 
INCOME 

POVERTY  INDEX 
NADULTS 
PSIINT 
PPVTINT 


Dependent  Variables 

The  dependent  variables  analyzed  are  generalized 
gain  scores  computed  for  the  Preschool  Inventory  (PSI)  and 
for  the  Peabody  Picture  Vocaublary  Test  (PPVT) .*  The 
construction  and  use  of  these  gain  scores  are  discussed 
earlier  in  this  report.     Generalized  gain  scores  for  the  PSI 
and  PPVT  (GPSI  and  GPPVT)  were  computed  for  each  child  in 
the  study  for  whom  data  were  available  for  Fall  1976  and 


*For  a  description  of  the  PSI  and  PPVT  and  their  psychometric 
properties  see  Bache,  1980b. 
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spring  1977.     Center-level  mean  gain  scores  (MGPSI  and 
MGPPVT)  and  median  gain  scores  (MDGPSI  and  MDGPPVT)  were 
then  calculated  for  each  of  the  57  centers  in  the  study,  m 
addition,  adjusted  ppvt  gain  scores  (RPPVT)  were  computed, 
correcting  for  two  covariables  found  to  be  slightly  correlated 
with  PPVT  gains  at  the  child  level  (see 'Note  1  following 
this  chapter) . 

Classroom  Structure  Variables 

The  three  classroom  structure  variables  are  group 
size  (NCHILD),  staff  count  (NSTAFF)  and  staff/child  ratio 
(RATIO).*    Observations  were  made  of  the  number  of  children 
and  staff  present  for  each  class  during  each  hour  throughout 
the  day  (9:00  Ah  to  4:00  Ph) ,  on  each  of  two  days  in  each  of 
five  months  in  the  Phase  III  year.     The  classroom  structi-re 
variables  were  computed  by  averaging  measurements  over  both 
aays,  for  each  of  the  five  time  points  in  the  day  care  year, 
for  the  three  morning  hours  (because  structured,  teacher- 
direcied  activities  are  largely  morning  phenomena),  m 
aadition  to  these  raw  figures,  transtormea  versions  of  these 
three  variables  were  computed:     log^^  [group  size]    (LCHILD) , 
log^O  [number  of  staff]    (LSTAFF) ,  and  log^^  [staff/child 
ratio]    (LRATIO).     These  measures  were  constructed  by  taking 
logarithn,s  at  the  observation  level  and  ^hen  aggregating  the 
logged  observations  in  the  same  manner  as  the  unlogged 
observations  (see  Note  2). 


*aeta5J^fn'i°'"J''"''"n'  ^"^^^les  are  described  in  more 
aetail  in  3.  Singer,  D.  Atfholter,  and  R  Gooarich  "v^rianr^^ 
components  and  the  Dependability  of  Measures  ^seS' in  ?hi 
National  Day  Care  Study,"  Abt  Associates,  1978? 
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Caregiver  Qualifications  Variables 


Variables  in  this  category  relate  to  the  education, 
training  and  experience  of  caregivers,  computed  at  the 
center  level.     EDUCATION  is  measured  as  the  mean  years  of 
education  of  staff  observed  in  the  morning  hours;  HIGHEST 
DEGREE  is  the  mean  highest  degree  (coded  as  an  ordinal 
scale)  of  staff  observed  in  the  center.     SPECIALIZATION  is 
the  proportion  of  staff  present  in  the  morning  hours  who 
have  had  specialization  in  subject  matter  related  to  children 
and  child  care.     prev  DC  EXP.   reflects  the  mean  years  of 
experience  observed  caregivers  have  had  in  day  care  centers 
other  than  the  center  in  which  they  presently  work;  CENTER 
EXP.   is  the  mean  number  of  years  that  caregivers  present  in 
the  morning  hours  had  worked  in  their  current  center. 


Covariables 


These  variables  were  used  in  regressions  to 
control  for  the  effects  of  possible  confounding  factors, 
such  as  socioeconomic  status  (SES)  and  race.     The  intent 
here  was  not  to  estimate  the  effects  of  these  variables,  but 
rather  to  adjust  for  them  in  some  manner  if  they  were  found 
to  be  associated  with  the  gain  scores.     MOTHER'S  ED,  FRACTION 
WHITE,   INCOME,  NADULTS,   PSIINT  and  PPVTINT  were  aggregated 
to  the  center  level  only  over  those  children  with  either  a 
valid  GPSI  or  a  valid  GPPVT  score.     MOTHER'S  ED  is  the  mean 
years  of  education  of  the  children's  mothers;  FRACTION  WHITE 
is  the  proportion  of  white  children.     INCOME  is  the  average 
income  of  families.     POVERTY  INDEX  is  the  fraction  of 
families  in  the  center's  1970  Census  tract  with  1969  income 
below  the  poverty  line.     NADULTS  is  the  average  number  of 
adults  in  the  children's  homes.     PSIINT  (PPVTINT)  is  the 
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average  number  of  days  between  the  two  testings  upvjn  vhich 
GPSI   (GPPVT)   is  based.     Although  there  were  many  more 
covariables  that  were  available,   these  seven  had  the  highest 
correlation  with  children's  gain  scores,   and  hence  possibly 
required  further  examination.     Recall  (see  Chapter  Two)  that 
at  the  child  level,   covariables  were  nearly  completely 
uncorrelated  with  generalized  change  measures* 

Analytic  Issues 

Before  delving  into  the  details  of  analysis,  there 
are  three  key  analytic  concerns  which  must  be  addressed* 
First,   there  is  the  question  of  the  unit  of  analysis,  i*e*, 
of  the  level  of  aggregation*     Next,   the  sample  must  be 
defined;   that  is,   it  must  be  decided  whether  all  57  centers 
should  be  included  in  a  single  analysis,   or  whether  the 
49-center  quasi-experiment  and  the  eight-center  Atlanta 
Public  Schools  substudy  should  be  treated  separately* 
Finally,  a  discussion  of  the  approach  to  regression  model 
construction  may  prove  informative* 

Unit  of  Analysis 

Effects  analyses  we  re  conducted  entirely  with 
variables  aggregated  to  the  center  level,   as  discussed 
previously  in  Chapter  Three.     The  center-level  aggregates 
are  based  upon  approximately  700  children  for  whom 
test  data  were  available  for  the  two  time  points  and  the 
staff  members  who  were  observed  in  the  centers*     Recall  that 
the  analyses  were  performed  at  the  center  level  rather  than 
at  the  classroom  level  for  three  reasons:     (a)  over  the  day 
care  year,   children  within  a  given  center  switched  classrooms, 
making  it  difficult  to  create  classroom-level,  child-oriented 

3')  2 
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variables;   (b)  even  if  the  classrooms  were  stable  entities, 
certain  classes  have  so  few  children  that  the  aggregated 
measures  would  not  be  very  stable;    (c)  the  absence  of 
significant  effects  of  within-center  (child-level)  variables 
means  that  center  aggregation  effects  are  not  problematic. 

Sample  Definition 

A  second  issue  is  Whether  to  analyze  data  from  all 
57  Phase  III  centers  together,   or  whether  to  treat  the 
49-center  quasi-experiment  and  the  eight-center  Atlanta 
Public  School  (APS)  substudy  separately.     Both  strategies 
have  merits;  for  the  NDCS  cognitive  main  effects  analysis, 
the  former  approach  was  taken. 

The  primary  justification  for  analyzing  the  two 
groups  separately  is  that,   in  addition  to  the  experimental 
manipulation  of  staff /child  ratio  in  all  NDCS  centers,  in 
the  APS  substudy  caregiver  roles  were  also  experimentally 
altered.     Interest  here,  however,   does  not  focus  upon 
caregiver  roles,  but  rather  upon  measures  of  classroom 
structure  and  caregiver  qualifications;  these  variables 
should  not  have  been  influenced  by  the  APS  manipulation.  It 
seems  reasonable,   therefore,   to  combine  both  groups  in  a 
single  analysis. 

In  addition,   the  APS  centers  contribute  valuable 
information  to  the  overall  description  of  day  care.  To 
analyze  the  two  groups  separately  would  alter  the  profile 
of  NDCS  centers  (that  is,   change  the  variability  patterns), 
which  in  turn  could  diminish  the  ability  to  detect  effects. 
Moreover,   since  the  data  set  is  so  small,   even  including  all 
57  centers,   it  seems  wise  to  retain  as  much  data  as  possible 
in  a  single  analysis. 
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To  ensure  that  this  approach  does  not  lead  to 
misleading  results,  however,   two  checks  have  been  inserted 
into  the  analysis.     First,  APS  data  have  been  separately 
analyzed  (at  the  classroom  level),   in  the  detailed  investi- 
gation of  the  APS.*     Second,   the  data  from  the  49-center 
quasi-experiment  were  examined  to  see  if  the  major  effects 
found  remained  in  the  absence  of  the  APS  data.  These 
validations,  coupled  with  the  major  analysis  of  the  57-center 
data  set,  produced  results  which  are  stronger  than  the 
results  of  one  of  the  individual  examinations  alone. 

Approach  to  Regression  Model  Construction 

Two  primarly  schools  of  thought  on  the  topic  of 
regression  model  construction  are  currently  active.  One 
enters  all  independent  variables  of  interest  into  a  model 
and  then  estimates  effects  on  the  basis  of  thlL"*  single 
regression?  the  second  takes  a  more  parsimonious  approach  to 
model  construction  and  selects  independent  variables  paying 
careful  attention  to  problems  of  multicollinearity .  Each 
approach  has  its  merits;   the  latter  was  chosen  for  the 
cognitive  main  effects  analysis. 

This  approach  has  several  advantages.  Most 
important,  when  the  independent  variables  are  not  truly 
independent  (i.e.,  when  they  are  multicollinear ) ,   the  former 
approach  may  yield  results  that  are  uninterpretable,  whereas 
a  more  exploratory  and  parsimonious  strategy  often  leads  to 
a  series  of  regression  equations  which  in  combination 
indicate  the  relationships  among  independent  and  dependent 
variables.     Many  of  the  variables  in  the  cognitive  main 
effects  analysis  are  collinear;   therefore,   this  approach 
seems  most  reasonable. 


♦Goodrich,  N.,   "The  Atlanta  Public  Schools  Day  Care  Experi- 
ment."    National  Day  Care  Study  Effects  Analyses.  Final 
Report  of  the  National  Day  Care  Study,  Volume  IV-C. 
Cambridge,  Mass.:     Abt  Associates  Inc.,  1980. 
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An  additional  justification  for  this  "lean" 
approach  to  model  construction  can  be  mounted  on  the  basis 
of  the  ability  to  detect  stable  effects.  By  studying  the 
changes  in  regression  coefficient  estimates  as  well  as 
changes  in  estimates  of  standard  errors,  it  is  possible  to 
acquire  valuable  information  about  the  variability  of  the 
data.    Moreover,  this  type  of  examination  can  aid  in  the 
detection  of  "outliers".     For  example,  it  is  possible  that 
the  residuals  from  a  regression  on  five  independent  variables 
could  approximate  a  normal  distribution,  whereas  the  residuals 
from  a  regression  involving  only  two  of  these  regressors 
could  highlight  certain  cases  which  appear  to  be  atypical. 
The  more  inclusive  strategy  could  mask  possible  outliers, 
while  the  more  parsimonious  approach  leads  to  many  more 
opportunities  to  detect  effects  of  this  sort. 

Data  Analysis 

Preschool  Inventory  (PSI) 

The  first  stage  in  the  analysis  of  the  PSI  general- 
ized gain  scores  was  to  examine  the  two-way  plots  of  mGPSI 
versus  each  of  the  available  regressors.     These  graphs 
suggested  that  group  size  bore  the  strongest  relationship  to 
cognitive  gains   (see  Figure  6.1).     staff  count  and  staff 
qualifications  also  appeared  to  be  associated- with  the  gain 
scores,  although  the  strength  of  these  relationships  was  not 
as  great.     Moreover,  the  covariables  seemed  to  be  unrelated 
to  MGPSI.     This  initial  indication  of  a  lack  of  covariable 
relationships  to  the  gain  scores  was  quite  heartening,  it 
suggested  that,  in  addition  to  the  lack  of  child-level 
covariable  confounding,  these  data  were  not  plagued  with  the 
confounding  of  such  variables  as  racial  composition  and 
socioeconomic  status  with  cognitive  gain  scores  as  so  many 
other  educational  studies  have  been  in  the  past. 
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Figure  6.1 
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The  correlation  matrix  among  the  variables  (Table 
6.2)  not  only  confirmed  what  the  scattergrams  had  suggested, 
but  also  served  to  highlight  the  interrelationships  among 
the  variables.    That  is,  it  illustrated  the  reasonableness 
and  importance  of  conceptualizing  the  regressors  as  three 
clusters  of  independent  variables  (classroom  structure, 
caregiver  qualifications,  covariables)   rather  than  as  14 
distinct  variables.    This  formulation  is  based  upon  the 
relatively  high  degree  of  correlation  within  each  variable 
set  and  the  relatively  low  degree  of  correlation  across  the 
sets.    Within  the  classroom  structure  variables,  the  correla- 
tion between  group  size  and  staff  count  is  so  high  as  to 
prohibit  entering  them  both  in  a  single  regression  without 
introducing  severe  multicollin-ar ity  problems.     Centers  in 
the  NDCS  were  chosen  to  minimize  the  correlation  between 
group  size  and  ratio,  making  it  possible  to  separate  out  the 
individual  effects  of  each  variable.    Due  to  the  correlations 
among  these  three  variables,   it  would  not  be  wise  to  include 
both  group  size  and  staff  count,  or  both  ratio  and  staff 
count,   in  a  single  model.     However,  since  group  size  and 
ratio  are  relatively  independent,  it  is  reasonable  to 
include  both  in  a  single  regression. 

Examination  of  the  correlations  among  the  staff 
qualifications  variables  also  suggests  problems  of  multicol- 
linearity  were  several  of  them  to  be  entered  in  one  regression. 
The  covariable  cluster  is  also  plagued  by  high  correlations. 
This  is  due  in  part  to  the  fact  that  five  of  the  variables 
are  SES-related.     An  attempt  was  made  to  create  one  SES 
variable  through  principle  components  analysis;  this  new 
variable  did  not  correlate  more  highly  with  the  gain  score, 
however,  than  any  of  the  individual  covariables,  lending 
further  credence  to  the  supposition  that  a  covariable  model 
was  unnecessary. 
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In  addition  to  highlighting  the  correlations 
within  the  three  sets  of  regressors,  Table  6.2  also  shows 
the  correlations  between  the  regressor  sets.     It  appears 
that  correlations  among  the  sets  of  variables  are  relatively 
low,   thus  enabling  different  types  of  variables  to  enter 
into  a  single  regression  without  introducing  severe  multi- 
collinearity . 


To  get  an  initial  picture  of  how  the  independent 
variables  were  related  to  the  PSI  gain  scores,  an  ordinary 
least  squares  (OLS)   stepwise  regression  was  done.     Of  the 
14  variables,   four  were  entered  into  the  equation  (in 
order  of  entry) :     LCHILD,   SPECIALIZATION,   CENTER  EXP,  and 
PREV  DC  EXP.     This  regression  reinforced  early  indications 
that  both  Classroom  structure  and  caregiver  qualifications 
were  associated  with  psi  gain  scores.     Note,  however,  that 
the  staff/child  ratio  did  not  enter  into  this  regression, 
suggesting  that  it  is  group  size  (and  the  corresponding 
staff  count)  that  is  associated  with  the  gain  scores,  and 
not  the  ratio.     A  plot  of  the  residuals  versus  the  fitted 
values  provided  no  evidence  of  heteroscedasticity .  Moreover, 
this  regression  further  strengthened  the  belief  that  it  was 
unnecessary  to  include  covariables  in  subsequent  models, 
because  they  remained  nonsignificant  even  when  the  effects 
due  to  Classroom  structure  and  caregiver  qualifications  were 
partialled  out.     Rather  than  dispense  with  the  covariables 
altogether  with  the  risk  of  arriving  at  misleading  results, 
however,   the  covariables  were  simply  set  aside,  while  more 
exploratory  types  of  analyses  were  conducted  using  the  other 
two  regressor  sets.     The  covariables  were  reintroduced  into 
several  subsequent  models  to  insure  the  "robustness"  of  the 
results  to  possibly  confounding  covariables. 
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Using  biweighted  regression,*  an  exami^iSt ion  was 
made  of  each  of  the  three  logged  classroom  structure  variables 
alone  and  in  conjunction  with  various  combinations  of  the 
caregiver  qualifications  variables.     This  analysis  proved 
very  enlightening  for  several  reasons.     First,  it  brought  to 
our  attention  several  data  points  which  appeared  to  be 
atypical.     Three  centers  (one  in  each  site)   consistently  had 
biweighted  weights  in  the  range  of  0.00  to  0.50;  that  is, 
they  had  large  residuals  in  both  the  OLS  and  biweighted 
fits.     On  the  basis  of  subsequent  investigation,  these  three 
centers  were  set  aside  from  the  analysis  of  outliers. 
Second,  this  examination  clearly  illustrated  the  problems 
that  multicollinear  regressors  tend  to  create.     Third,  it 
stressed  the  need  not  only  to  biweight  analyses,  but  also  to 
weight  by  the  number  of  children  in  each  center  with  valid 
gain  scores. 

Biweighted  regression  analysis  proved  to  be  a  very 
useful  analytic  tool.*    For  example,  the  results  of  biweighted 
regressions  helped  to  illustrate  the  multicollinearity 
problems  present  in  these  data.     Table  6.3  presents  the  OLS 
and  biweighted  regression  coefficients  for  the  consecutive 
stages  of  the  stepwi.se  regression  previously  described.  The 
OLS  coefficients  and  their  respective  t-statistics  for  the 
variable  LCHILD  appear  to  be  relatively  stable,  as  do 
the  significance  levels  attached  to  them.     Examination  of 
the  biweighted  coefficients,  however,  suggests  that  the 
estimates  are  only  stable  when  no  more  than  one  of  the 
caregiver  qualifications  variables  is  present,  that  is,  when 
the  regressors  are  not  highly  correlated.     In  the  presence 
of  two  qualifications  variables  the  coefficient  for  LCHILD 
begins  to  fluctuate,  and  when  the  three  collinear  carriers 


*See  Appendix  2  for  a  detailed  description  of  biweighted 
regression. 
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are  entered,  the  biweighted  estimate  is  quite  different  from 
the  OLS  estimate.     The  t-statistics  also  fluctuate  as  a  func- 
tion of  the  multicollinearity:     prev  DC  EXP.  is  significant 
at  first?   it  loses  ground  when  SPECIALIZATION  is  included? 
then,   in  the  presence  of  all  three  qualifications  variables, 
PREV  DC  EXP.   is  significant  again.     This  is  due  to  the 
effect  that  multicollinearity  has,  not  only  on  the  estimated 
coefficients,  but  on  their  estimated  variances  as  well. 
Therefore,   due  to  the  relatively  high  correlations  among  the 
qualifications  variables,   simpler  models — suffering  less 
from  multicollinearity — were  sought  after. 


Table  6.3 

REGRESSION  COEFFICIENTS  FOR  REGRESSION  OF 


Ordinary  Least 

Squares 

(OLS)  and  Biweighted 

Least 

Squares  (BLS) 

(N=57) 

OLS  Standard 
Carriers            Coefficient  Error 

t 

P 

Value 

ELS 
Coefficient 

Ri 

LCHILD 

-3.74 

1.41 

-2.66 

.0099 

-3.67 

.11 

LCHILD 

PREV  DC  EXP. 

-3.82 
0.16 

1.36 
0.07 

-2.82 
2.30 

.0067 
.024 

-3.58 
0.15 

.19 

LCHILD 

PREV.  DC  EXP. 
SPECIALIZATION 

-3.89 
0.12 
1.22 

1.32 
0.07 
0.59 

-2.95 
1.74 
2.08 

.0049 

.084 

.040 

-3.03 
0.12 
1.28 

.25 

LCHILD 

PREV  DC  EXP. 

SPECIALIZATION 

CENTER  EXP. 

-4.16 
0.18 
1.96 

'-0.17 

1.29 
0.07 
0.59 
0.12 

-3.06 
2.47 
3.17 

-1.33 

.0038 
.016 
.0029 
.190 

-2.44 
0.18 
2.11 

-0.23 

.31 

Biweighting  also  reinforced  the  need  for  performing 
weighted  least  squares.     Since  the  center-level  aggregations 
were  computed  with  varying  numbers  of  children,   the  inforr.iation 
contained  in  each  case  had  a  varying  level  of  accuracy  or 
stability.     Furthermore,  weighting  by  the  appropriate  number 
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of  children  alleviates  problems  created  by  undue  influence 
of  small  centers  with  few  children,  whereas  equal  weighting 
would  tend  to  disproportionately  favor  those  centers. 

In  summary,  due  to  multicollineari ty  problems 
introduced  when  several  qualifications  variables  were 
entered  in  the  same  regression,  an  effort  was  made  to 
construct  simpler  models  that  would  adequately  portray  the 
combined  associations  of  classroom  structure  and  staff 
qualifications  with  gain  scores.     In  addition,  three  centers 
were  identified  as  atypical  (outliers),  and  set  aside  from 
subsequent  analyses.     Both  weighted  least  squares  and 
weighted-biweighted  least  squares  techniques  were  used  for 
the  remaining  analyses. 

The  next  stage  in  analysis  was  to  fit  relatively 
simple  models  with  each  of  the  three  classroom  structure 
variables  alone  and  in  conjunction  with  PREV  DC  EXP.  and 
SPECIALIZATION  (Note  3).     In  addition,   the  pair  of  variables 
LCHILD  and  LRATIO  were  jointly  examined  in  this  context. 
The  results  of  one  set  of  these  analyses  (for  LCHILD)  appears 
in  Table  6.4.     Not  only  is  group  size  negatively  associated 
with  cognitive  gains  (i.e.,  larger  groups  are  associated 
with  lower  mean  gains) ,  but  holding  group  size  constant, 
higher  gains  are  also  associated  with  staff  who  have  had 
previous  day  care  experience  and/or  special  courses  in 
child  development.     The  stability  of  the  biweighted  coef- 
ficients reinforces  the  strength  of  this  finding. 

Results  for  the  other  two  classroom  structure 
variables  are  nonsignificant;  however,  the  signs  are  in  the 
expected  direction  (Note  4).     Furthermore,  when  both  group 
size  and  ratio  are  entered  together,  group  size  remains 
significant  while  ratio  never  approaches  significance.  When 
ratio  alone  is  entered,  with  or  without  the  two  staff 


286 

^  ^ 


Table  6.4 

RESULTS  OF  WEIGHTED  AND  WEIGOTEI>-flIMEIG»rED  REGRESSIONS 
ON  MGPSI  FOR  SELECTED  VARIABLES 


Independent 
Variables 

Weighted 

Regression 

Cbefficient 

Standard 
Error 

t 

P 

Value 

Weighted 
Biweighted 
Regression 
Coefficimt 

R^  (for 

weighted 

regression) 

.13 

LCHILD 

-3.79 

1.38 

-2.74 

.0083 

-3.40 

LCHILD 
PREV  DC  EXP. 

-3.81 
.16 

1.34 
.08 

-2.84 
2.02 

.0065 
.046 

-3.38 
.15 

.19 

LCHILD 

SPECIALIZATION 

-4.31 
1.35 

1.33 
.53 

-3.24 
2.55 

.0025 
.013 

-3.13 
1.57 

.23 

qualifications  variables,  not 

only 

is  its 

contributio 

n 

nonsignificant,  but  PREV  DC  EXP.  and  SPECIALIZATION  also  are 
nonsignificant.  This  suggests  that  group  size  and  caregiver 
characteristics  ought  to  be  considered  jointly. 

To  check  for  the  stability  of  these  results  in  the 
presence  of  covariables,  weighted  and  weighted-biweighted 
regressions  were  estimated  using  the  three  sets  of  regressors 
in  Table  6.4,  in  conjunction  with  each  of  the  covariables. 
In  every  instance,  the  covariables  were  nonsignificant; 
furthermore,  they  hardly  exerted  any  influence  on  the  esti- 
-■nates  of  the  other  coefficients.     This  result  strengthened 
the  earlier  belief  that  the  inclusion  of  covariables  was  not 
necessary. 


In  order  to  protect  these  results  from  the  possi- 
bility that  mean  center  gain  scores  are  unduly  influenced  by 
extreme  individual  scores  within  a  given  cetner,  the  above 
regressions  were  re-estimated  using  median  PSI  gain  scores 
(MDGPSI).     The  results  were  somewhat  weaker  than  those  using 
the  mean  gains;  however,  they  indicated  the  same  findings  as 
previously  noted. 


3i3 


A  potential  threat  to  the  validity  of  conclusions 
concerning  cognitive  gains  of  children  in  the  NDCS  sample 
can  be  argued  from  differential  attrition  in  the  3ampJ.e,  by 
center.     If  attrition  is  .associated  with  some  quality  of 
"thrivingness"  in  a  day  care  seting,   if  " thrivingness"  is 
associated  with  cognitive  gains,   and  if  attrition  is  also 
associated  with  the  policy  variables  under  consideration, 
then  any  conclusions  regarding  the  effects  of  policy  vari- 
ables on  cognitive  gains  may  be  distorted  by  differential 
attrition  by  center.     The  direction  of  distortion  depends 
upon  the  empirical  relationships  among  attrition,  cognitive 
gains,   and  policy  variables;  that  is,  purported  effects  may 
be  either  attenuated  or  exaggerated. 

A  simple  example  can  be  developed  to  illustrate 
both  possibilities.     Suppose  that  attrition  and  cognitive 
gains  are  associated,   and  that  centers  with  higher  attrition 
rates  are  composed  di^'n  oportionately  of  "thrivers". 
Suppose  further  that  attrition  and  group  size  are  positively 
associated,  that  classes  with  larger  enrollments  tend  to 
have  higher  attrition  rates.     (For  instance,   signs  of 
"nonthrivingness"  are  more  liXely  to  be  observed  by  parents 
of  children  in  large  classes,  with  resulting  higher  frequen- 
cies of  removal  of  "nonthrivers"  from  the  day  care  context.) 
If  group  size  is  negatively  associated  with  cognitive  gains, 
ceteris  paribus,  then  that  result  is  somewhat  attenuated  by 
attrition:     disproportionate  representation  of  "thrivers"  in 
large  clasc  rooms  would  dcunpen  negative  effects  of  group  size 
on  cognitive  gains,   since  "thrivers"  are  expected  to  have 
higher  gain  scores  than  "nonthrivers • " 

By  changing  one  relationship  in  the  hypothetical 
argument  given  above,  the  consequences  of  differential  at- 
trition change.     Suppose,  now,  that  group  size  is  negatively 
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associated  with  attrition  (larger  classes  have  lower  attri- 
tion rates,  or  larger  classes  effectively  mask  signs  of 
-nonthrivingness-).     if  the  other  relationships  postulated 
in  the  paragraph  above  still  hold,   then  the  negative  effects 
of  group  size,  ceteris  paribus,  are  somewhat  exaggerated  by 
attrition.     Disproportionate  representation  of  "nonthrivers" 
in  larger  classrooms  exacerbates  the  negative  effects  of 
group  size  on  gains  since  "nonthrivers"  are  expected  to  have 
lower  gain  scores. 


Attrition  rates  (fraction  of  children  in  the  NDCS 
sample  attrited  between  Fall  1976  and  Spring  1977)  were 
calculated  for  each  center  and  correlated  with  the  major 
policy  variables.     The  results  appear  in  Table  6.5.  Negative 
effects  of  group  size  may  be  somewhat  exaggerated,  and  posi- 
tive effects  of  caregiver  characteristics  may  be  somewhat 
attenuated  by  differential  attrition— but  none  of  the 
relationships,  are  strong  enough  to  attain  statistical 
significance  at  the  .10  level.     Apparently,  a  serious  threat 
to  the  validity  of  the  NDCS  cognitive  effects  conclusions 
cannot  be  mounted  on  the  basis  of  differential  attrition. 

Another  possible  threat  to  the  findings  in  this 
analysis  is  disproportionate  influence  of  the  few  data 
points  on  fitted  equations.     Further  examination  of  PREV  DC 
EXP.  indicated  that  the  significant  results  for  this  variable 
were  mainly  due  to  four  centers  in  the  study.     These  centers 
had  the  highest  values  for  PREV  DC  EXP.  and  correspondingly 
high  PSI  gain  scores.     Although  the  direction  of  relation- 
ships between  cognitive  gains  and  previous  day  care  experience 
remains  the  same  when  these  four  centers  are  eliminated  from 
the  analysis,  the  strength  of  the  association  is  substantially 
weakened  and  this  variable  is  no  longer  significant.  This 
behavior  is  illustrated  in  Figure  6.2.     Examination  of  this 
graph  of  MGPSI  versus  PREV  DC  EXP.  reveals  a  strong  positive 
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Table  6.5 

CORRELATIONS  BETWEEN  FRACTION  ATTRITED 


AND  OTHER  VARIABLES 


Center-Level  Correlations 
(N-57) 


Variables 


Correlation 


M6PSI 


.17 


LCHILD 


-•10 


LSTAFF 


-.18 


LRATIO 


-.12 


HIGHEST  DEGREE 


-.08 


EDUCATION 


-.05 


SPECIALIZATION 


-.20 


PREV  DC  EXP. 


-.18 


slope.     If  the  centers  with  the  extremely  large  values  of 
PREV  DC  EXP.   (greater  than  5.00)  are  set  aside,  the  effect  is 
severely  attenuated  and  is  no  longer  significant.    This  is 
not  to  say  that  these  centers  are  outliers  which  should  be 
removed  from  the  analysis,  and  that  there  is  no  association 
between  previous  day  care  experience  and  PSI  gain  scores. 
Data  in  the  extremes  of  the  independent  variables  are 
usually  considered  high  leverage  points?  that  is,  they  exert 
more  influence  upon  the  regression  estimation  procedure  than 
do  the  points  in  the  middle  of  the  distribution.     If  there 
was  simply  one  center  with  an  extremely  high  value  on  this 
variable,   it  would  probably  have  been  considered  an  outlier 
and  set  aside.     Since  there  are  four  centers  with  this 
characteristic,  however,  it  is  not  desirable  to  call  them 
all  outliers,  because  we  may  be  eliminating  valuable  data. 
The  problem  becomes  one  of  not  having  a  sufficient  number  of 
centers  with  large  amounts  of  previous  day  care  experience 
to  draw  solid  conclusions.     Therefore  the  findings  for  this 
variable  cannot  be  considered  definitive. 
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GPSI  VERSUS  PREVIOUS  DAY  CARE  EXPERIENPR 
CENTER  LEVEL  ~ 


As  an  additional  check  on  the  stability  of  the 
findings,  a  type  of  cross-validation  was  done.     The  sample 
was  partitioned  into  four  sections:     APS,  Atlanta  Non-APS, 
Detroit  and  Seattle,     Ideally,  separate  analyses  would  have 
been  conducted  within  each  subsample.     However,  since  each 
subsample  was  too  small  to  support  separate  analysis,  the 
cross-validation  involved  analyzing  different  combinations 
of  subsamples,  omitting  a  different  one  (or  two)   in  each 
case.     A  portion  of  the  results  of  these  validations  appear 
in  Table  6.6.     On  the  whole,  these  results  support  the 
hypothesis  that  group  size  and  specialization  are  associated 
with  cognitive  gains.     There  are  refinements  of  this  hypothesis, 
however,  that  need  to  be  made.     First,  there  are  subsamples 
of  the  data  in  which  ratio  is  a  significant  variable,  most 
notably  when  Atlanta  Non-APS  and/or  Seattle  i  :  removed. 
There  is  no  immediately  apparent  reason  for  this  behavior. 
Moreover,   ratio  is  significant  when  APS  is  removed  from  the 
sample,  but  the  coefficient  is  so  unstable  when  biweighted 
that  the  actual  significance  may  be  doubtful.     It  is  important 
to  note  that  in  those  subsamples  for  which  ratio  is  signifi- 
cant, group  size  alone  is  also  significant.     The  essentially 
null  findings  with  respect  to  ratio  stands,  therefore, 
through  this  validation. 

The  results  for  group  size  and  caregiver  qualifi- 
cations are  not  as  clearly  defined.     First,  the  group  size 
effect  appears  to  be  the  strongest  in  the  APS/Detroit 
subsample,  while  the  caregiver  qualifications  variables  are 
weakest  in  this  subsample.     In  the  complementary  subsample, 
Atlanta  Non-APS/Seattle,  exactly  the  reverse  effects  emerge 
(strong  qualifications  and  weaker  group  size  results). 
There  is  no  a  priori  reason  for  this  particular  partition — 
APS  and  Detroit,  Atlanta  Non-APS  and  Seattle — and  while  it 
may  produce  a  distortion  of  the  effects,  there  is  no  apparent 
explanation  for  this  behavior.     When  all  Atlanta  centers  are 


Table  6.6 

REGRESSION  COEFFICIENTS  MGPSI  ON  SELECTED  POLICY  VARIABLES 

(Regressions  are  weighted  by  number  of  children 
in  center  with  valid  gain  scores) 
  (N«54) 

CODE:     APS    =  APS  DErroetroit 
NAPS  =  Atlanta  Non-APS    SEA  =»  Seattle 


ALL 


All  Sites 


Sites 

1 

1  LCHILD 

SPECIAL- 1 
r NATION  1 

LRATIO 

SPECIAL- 
IZATION 

ALL  rin<*-^a11 

Ct] 

[biweighted] 

1  -4.31 
1  (-3.24) 
1  -3.13 

1-35  1 
(2.55)  1 
1.57  1 

1.98 
(1.19) 
.335 

1.04 
(1.84) 
1.87 

NAPS -DET  ^PA 

(49  Centers) 

1  -2.60 
1  (-2.08) 
1  -.153 

1.34  1 
(2.49)  1 
1.86  1 

.508 
(.369) 
.091 

1.11 
(2.00) 
1.78 

APS. NAPS  nPT 

\  —4.84 
1  (-3.03) 
1  -3.26 

1.48  1 
(2.46)  1 
1.73  1 

1.85 
(0.90) 
0.12 

1.13 
(1.72) 
2.07 

APQ    nPT  CP& 

1  -5.46 
1  (-3.13) 
1  -5.29 

0.98  1 
(1-41)  1 
1.01  1 

6.09 
(1.78) 
4.03 

•  301 
(.359) 
.939 

APS^NAPS,SEA 

1  -4.68 
1  (-2.83) 
1  -1.72 

1.62  1 
(2.28)  1 
2.17  1 

2.51 
(1.44) 
.066 

1.24 
(1.67) 
5.82 

APS, NAPS 

1  -5.73 
1  (-2.62) 
1  -2.34 

1.93  1 
(2.15)  1 
2.29  1 

2.56 
(1.09) 
.435 

1.40 
(1.46) 
2.22 

DETrSEA 

1  -2,81 
1  (-1*68) 
1  -2.75 

0.38  1 
(0.45)  1 
0.42  1 

.533 
(.188) 
.497 

.101 
(.110) 
.246 

NAPS, SEA 

1  -2.81 
1  (-1.68) 
1  -2.75 

1.46  1 
(2.35)  1 
2.17  1 

1.35 
(1.03) 
.687 

1.67 
(2.48) 
2.37 

APS,DET 

1  -6,62 
(-2.72) 
-6.78 

1.12  1 
(1.26)  1 
1.15  1 

11.06 

(1.67) 

10.50 

-0.84 
(-.070) 
.174 
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removed,  the  caregiver  specialization  effect  disappears. 
Thi*^  is  due,   in  part,  to  the  fact  that  the  centers  in 
Atlanta  have  caregivers  with  more  specialized  training  than 
in  the  other  two  sites,    when  these  centers  are  removed  from 
the  sample,  therefore,  variability  in  qualifications  is 
markedly  reduced,  decreasing  their  strength  as  regressors. 
Hence,  there  are  certain  partitions  of  the  sample  which  will 
alter  the  distributions  of  the  independent  variables  which, 
in  turn,  may  increase  or  decrease  their  predictive  power. 
Although  the  magnitude  and  relative  significance  of  certain 
effects  may  vary  from  partition  to  partition,  the  direction 
of  the  effects  is  never  reversed.     The  basic  conclusions  do 
not  appear  to  be  threatened. 


parallel  to  that  of  the  PSI.  Analyses  used  both  the  aggre- 
gated PPVT  gain  scores  (MGPPVT)  and  the  covar iable-adjusted 
gain  scores  (RPPVT) ,  as  discussed  above. 

Preliminary  examination  of  the  PPVT  gain  scores 
through  plots  nad  correlations  suggested  that  as  with  the 
PSI,   the  variables  GROUP  SIZE  and  STAFF  COUNT  are  strongly 
associated  with  gains.     For  example,  a  plot  of  RPPVT  versus 
NCHILD  appears  in  Figure  6.3.     The  center-level  correlations 
between  the  PPVT  gains  and  the  independent  variables  appear 
in  Table  6.2.     Examination  of  this  correlation  matrix  shows 
that  not  only  are  the  classroom  structure  variables  associ- 
ated with  gains,  but  the  two  caregiver  education  variables 
(HIGHEST  DEGREE  and  EDUCATION)  appear  to  be  strongly  related 
to  PPVT  gains.     Furthermore,  unlike  the  PSI,  caregiver 
experience  and  specialization  do  not  seem  to  be  associated 
with  PPVT  gains.     Although  two  of  the  covariables  (FRACTION 
WHITE  and  NADULTS)  are  moderately  correlated  with  MGPPVT, 


Peabody  Picture  Vocabulary  Test  (PPVT) 


The  analysis  of  PPVT  gain  scores  was  co 


nducted  in 


the  covariable-adjusted  RPPVT  does  not  suffer  from  this 
problem.     All  analyses  have  been  conducted  using  both  these 
gain  scores;  however,  attention  here  is  focused  primarily 
upon  the  RPPVT. 


run  using  group  size,   staff  count,   and  the  caregiver  educa- 
tion variables.     Staff  count  performed  slightly  better  than 
group  size  in  these  analyses,  but  because  of  the  previously 
mentioned  correlation  between  the  two,   the  implications 
remain  the  same — classrooms  with  fewer  children  and  staff 
tend  to  be  associated  with  higher  cognitive  gain  scores. 
The  results  for  caregiver  education  variables  are  not  as 
clearly  defined-     When  the  caregiver  educatoon^j^ari^M^gs^ — — 
were  entered  into  reqressT — the-^xcwelgTfted  coefficients 
became  very  unstable.     Examination  of  the  regression  resi- 
duals and  weights  from  the  biweighted  estimation  showed 
three  centers  with  consistently  large  residuals  and,  hence, 
consistently  low  weights.     These  three  centers  were  those 
previously  determined  to  be  outliers  in  the  PSI  analysis. 
This  problem  is  illustrated  in  Figure  6.4.     In  this  plot  of 
RPPVT  vs.  EDUCATION,   the  centers  which  are  circled  (with 
arrows  pointing  towards  them)  are  the  three  centers  in 
question.     On  this  graph  there  is  a  distinct  positive  slope; 
however,  without  these  three  points,   the  slope  flattens  out 
considerably.     Hence,  these  three  centers  were  again  deleted 
from  further  analyses. 


regressions  were  then  estimated  using  group  size  and  staff 

count  separately,  and  each  in  conjunction  with  the  caregiver 

qualifications  variables.     Selected  results  of  these  analyses 

2 

appear  in  Table  6.7.     Note  that  the  R  s  are  substantially 
lower  than  those  obtained  for  the  PSI.     In  most  instances, 
however,   effects  are  in  the  same  direction.     The  PPVT 


Exploratory  OLS  and  biweighted  regressions  were 


Weighted  regression  and  weighted-biweighted 
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Figure  6,4 

RPPVT  VERSUS  EDUCATION 
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Table  6.7 

RESULTS  OF  WEIGHTED  AND  WEIGHTED-BIWEIGHTED  REGRESSIONS  ON  PPVT  GAINS 
FOR  SELECTED  VARIABLES 
(N=54) 


Dependent 
Variable 

MGPPVT 


RPPVT 


Independent 
Variables 


Weighted 

Regression  Standard 
Coefficient  Error 


Weighted 

Biweighted  R^  (for 

P       Regression  Weighted 

Value     Coefficient  Regression 


LCHILD 

-5.20 

2.80 

-1.86 

.065 

-8.59 

.06 

LSTAFF 

-4.84 

2.49 

-1.94 

.055 

-5.72 

.07 

LSTAFF 

-5.54 

2.50 

-2.21 

.030 

-6.53 

PREV  DC  EXP. 

.24 

0.16 

1.52 

.13 

.29 

.11 

LSTAFF 

-4.83 

2.55 

-1.90 

.060 

-6.30 

SPECIALIZATION 

-.03 

1.14 

-.03 

.97 

.93 

.07 

LSTAFF 

-5.24 

2.49 

-2.10 

.038 

-6.56 

EDUCATION 

.45 

.35 

1.28 

.20 

.50 

.10 

LSTAFF 

-5.13 

2.46 

-2.08 

.040 

-6.36 

HIGHEST  DEGREE 

1.33 

.86 

1.54 

.13 

1.40 

.11 

LCHILD 

-4.09 

2.64 

-1.55 

.12 

-7.25 

.04 

LSTAFF 

-3.36 

2.36 

-1.42 

.16 

-3.38 

.04 

LSTAFF 

-4.07 

2.37 

-1.72 

.088 

-4.27 

PREV  DC  EXP. 

.25 

.15 

1.63 

.11 

.26 

.08 

LSTAFF 

-3.65 

2.40 

-1.52 

.13 

-4.08 

SPECIALIZATION 

.22 

1.07 

.66 

.52 

.28 

.05 

LSTAFF 

-3.56 

2,39 

-1.49 

.14 

-3.77 

EDUCATIOJ 

..22 

.34 

.66 

.52 

.28 

.05 

LSTAFF 

-3.51 

2.38 

-1.48 

.14 

-3.71 

HIGHEST  DEGREE 

.68 

.83 

.82 

.58 

.75 

.05 
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results  may  be  best  viewed  as  confirming  those  obtained  for 
the  PSI  rather  than  as  solid  evidence  in  their  own  right. 
Also  note  that  the  only  variables  that  approach  significance 
are  GROUP  SIZE,   and  STAFF  COUNT.     Although  PREV  DC  EXP.  has 
the  highest  t-statistic  of  any  of  the  caregiver  qualifications 
variables,  this  is  primarily  due  to  the  same  four  centers 
that  created  a  significant  effect  for  this  variable  for  the 
PSI.     Furthermore,  the  variables  SPECIALIZATION,  EDUCATION 
and  HIGHEST  DEGREE  do  not  appear  to  be  significantly  related 
to  the  PPVT  gain  scores.     On  the  basis  of  these  analyses, 
then,  the  size  of  the  classroom  grouping  (as  measured  by 
group  size  and  staff  count)  is  the  only  factor  that  is 
associated  with  PPVT  gains. 

As  was  done  for  the  PSI,   an  analysis  of  the  median 
PPVT  gains  was  performed.     Although  these  results  were  somewhat 
weaker  than  those  for  mean  gains,   they  remained  the  same. 

Summary 

The  data  provide  clear  evidence  that  the  structure 
of  the  day  care  classroom~the  configuration  of  children  and 
caregivers— is  associated  with  children's  acquisition  of 
certain  skills,  as  measured  by  the  PSI  and  PPVT.  Moreover, 
there  is  evidence  that  certain  aspects  of  caregiver  qualifi- 
cations are  likewise  related  to  child  outcomes. 

The  results  of  these  analyses  suggest  certain 
configurations  of  caregivers  and  children  to  be  encouraged, 
other  considerations  for  policymakers  not  withstanding. 
Certers  in  which  classes  were  composed  of  small  groups  of 
children  interacting  with  few  caregivers  had  higher  cognitive 
gain  scores  on  the  average  than  centers  where  the  classes 
were  comprised  of  large  numbers  of  children  with  correspon- 
dingly more  caregivers.     Within  a  range  of  reasonable 
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ratiosr  it  is  the  sheer  magnitude  of  the  classroom — the 
number  of  people  present,  not  the  prevailing  staff/child 
ratio — that  is  most  strongly  associated  with  gains.  To 
illustrate  the  association  between  classroom  configurations 
and  cognitive  gains,  a  plot  of  group  size  and  staff  count 
(and  hence  ratio)  with  the  cognitive  gain  scores  was  con- 
structed (see  Figures  6.5  and  6.6).     The  rays  drawn  on  the 
graph  are  lines  of  constant  ratio.     To  reduce  a  three- 
dimensional  graph  to  two  dimensions,  the  distributions  of 
MGPSI  and  RPPVT  were  divided  at  the  median  and  two  different 
symbols  were  used  to  represent  the  third  dimension.*  As 
previously  indicated,  on  the  whole,  centers  comprised  of 
classrooms  with  small  groups  of  children  and  few  caregivers 
appear  to  be  better  for  children  than  those  in  which  classes 
have  more  caregivers  and  correspondingly  larger  groups  with 
similar  staff/child  ratios.     The  distribution  of  gain  scores 
does  not  appear  to  be  affected  by  slight  changes  in  the 
staff/child  ratio  (within  this  narrow  band  of  ratios).  That 
is,  there  does  not  appear  to  be  a  concentration  of  centers 
with  higher  gains  in  the  higher  ratio  centers.     In  addition 
to  highlighting  earlier  results,  the  plots  illustrate  that 
it  is  virtually  impossible  to  separate  out  the  effects  of 
group  size  and  staff  count;  it  is  essential  that  they  be 
considered  jointly . 

In  addition  to  the  conclusions  about  classroom 
groupings,  analyses  provided  information  aobut  the  associa- 
tions between  caregiver  qualifications  and  cognitive  gains. 
First,  although  the  amount  of  previous  day  care  experience 
was  significantly  related  to  cognitive  gains,  this  result  is 


*A  word  of  caution  must  be  given  here  before  interpreting 
these  graphs.  Because  the  gain  scores  have  been  recorded 
only  as  above  or  below  the  median,  a  great  deal  of  infor- 
mation about  their  variability  has  been  lost.  While  they 
show  whether  a  center's  gain  score  was  above  or  below  the 
median,  they  do  not  show  how  far  above  or  below. 


300 


'•2G 


I  NSTAFF 


Figure  6.6 

NSTAFF  VERSUS  NCHILD 
BY  RPPVT 


CENTER  LEVEL 


A RPPVT  above  median  (7.8) 
7RPPVT  below  median 


4  - 


RATIO 
1:7 


due  primarily  (as  previously  described)  to  four  centers 
Whose  caregivers  had  high  amounts  of  previous  experience  and 
whose  children  had  high  cognitive  gain  scores.    On  the  basis 
of  these  analyses  then,  one  cannot  say  very  much  about  the 
effect  of  previous  day  care  experience  upon  gain  scores. 
Second,  the  amount  of  formal  education  by  itself  bore  no 
significant  relationship  to  cognitive  gains.    Third,  caregiver 
specialization  in  child-related  fields  such  as  developmental 
psychology,  early  childhood  education  or  special  education 
was  associated  with  children's  PSI  gain  scores.  Note, 
however,  that  the  fraction  of  caregivers  with  specialized 
education  in  a  center  appeared  to  be  unrelated  to  PPVT  gains. 

With  the  results  of  classroom  groupings  and 
caregiver  specialization  in  mind,  we  now  consider  whether 
these  are  two  independent,  dimensions  of  quality  of  care  or 
if  they  must  be  considered  jointly.     A  simple  example  will 
illustrate  the  difference  between  these  two  possibilities. 
It  has  been  shown  that  classrooms  comprised  of  smaller 
groups  and  caregivers"~with  specialized  education  or  training 
are  both  associated  with  higher  gains,     it  could  be  the  case 
that  specialized  caregivers  would  be  effective  with  groups 
of  varying  sizes  while  caregivers  without  specialization 
would  only  be  effective  with  smaller  groups.    On  the  other 
hand,   it  might  be  that  all  caregivers  (regardless  of  their 
level  of  specialization)  would  be  more  effective  with 
smaller  groups  and  that  specialized  caregivers  are  more 
effective  than  non-specialized  ones  with  groups  of  any  size. 
In  the  former  case,  there  .is  said  to  be  a  statistical 
interaction  between  specialization  and  group  size;   in  the 
latter  case,  the  effects  are  said  to  be  additive.    As  shown 
in  Figure  6.7,  the  effects  of  specialization  and  group  size 
appear  to  be  simply  additive,     m  this  graph  of  specializa- 
tion, group  size  and  PSI  gain  scores,  there  is  a  large 
concentration  of  high  gain  scores  in  those  centers  where 


32'3 


Figure  6.7 


8PECIAUZATI0N 

4t  • 


0 

lb 


SPECIALIZATION  VERSUS  GROUP  SIZE 

byIgpsi  !i5i!E 

CENTER  LEVEL  ^  MGPSI  ABOVE  HEDIWI(6.30) 

V  HGPSI  BELOW  MEDIAN 


ii  A  A  7 

AA  A 


A 


A  A 

A  ki 
A 


V 

«n  -I-  A  in 

.00  "H 


V  • 

AV  Vy 


V 


.50+  ^         ^    V  / 

V      ^     A  V  A 


I 
I 


there  are  smaller  groups  and  more  specialized  caregivers. 
Furthermore,  the  benefits  of  small  group  size  appear  to  hold 
regardless  of  the  level  of  specialization  and  the  benefits 
of  specialization  seem  to  remain  regardless  of  the  group 
size.     It  appears,  then,  that  specialization  and  group  size 
may  be  considered  important  and  relatively  independent 
dimensions  in  day  care  that  influence  children's  acquisition 
of  certain  skills,  as  measured  by  the  PSI  and  PPVT  (Note 
5)  . 
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NOTES  TO  CHAPTER  6 


The  RPPVT  was  computed  as: 

RPPVT  =  GPPVT  -  1,852   (FRACTION  WHITE)   -  1,05  (NADULTS) 

The  correlation  between  RPPVT  and  GPPVT  was  approximately 
.97  and,   in  every  case,  analyses  conducted  upon  each 
variable  led  to  the  same  results. 

This  transformation  was  done  for  several  reasons. 
First,  when  data  consist  of  counts,  a  log  transform 
often  mitigates  undesirable  distributional  properties  in 
the  sample  data.     Second,  since  ratio  is  the  quotient  of 
NSTAFF  divided  by  NCHILD,  ratio  in  the  log  metric  is  a 
linear  combination;   in  fact,  the  simple  difference  of 
the  other  two  logged  counts.     Third,  the  zero-order 
correlations  among  these  three  variables  are  slightly 
lower  in  the  log  scale  than  in  the  raw  scale,  thus 
helping  to  reduce  the  problem  of  multicollinearity. 
Because  the  correlation  between  the  logged  and  unlogged 
variables  is  high  (on  the  order  of  .95  to  .99),  there  is 
little  difference  between  results  using  the  two  sets  of 
measures.     For  analytic  purposes  the  logged  variables 
are  used;  for  displays,  the  untransf ormed  data  are 
shown  to  provide  easy  interpretation. 

CENTER  EXP  was  dropped  from  this  analysis  for  two 
reasons.     First,  investigation  indicated  that  slight 
errors  had  been  made  in  the  creation  of  the  variable. 
These  mistakes  were  exacerbated  by  improperly  aggregating 
to  the  center  level.     Second,  not  only  was  this  variable 
an  insignificant  predictor  of  MGPSI  individually,  but  it 
was  never  significant  when  included  in  regressions  with 
the  classroom  structure  variables. 

One  possible  explanation  for  the  "superior"  performance 
of  group  size  over  staff  count  is  the  relative  lack  of 
variation  in  staff  count  compared  to  variation  in  group 
size. 

Although  it  is  possible  to  state  that  centers  with 
smaller  classroom  groupings  and  more  specialized  care- 
givers tend  to  have  higher  cognitive  gain  scores,   it  is 
difficult  to  state  the  precise  numbers  of  children  and 
car eg ivers  in  those  small  configurations,  and  the 
fraction  of  staff  with  specialized  training,  that  should 
be  encouraged.     The  variables  analyzed  were  center-level 
averages  of  many  classroom-level  observations  of  group 
size,  staff  count  and  ratio,  and,  as  such,  they  are 
continuous  variables.     The  data  were  examined  for 
nonlinear  trends,  or  possible  inflection  points,  and 
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none  were  found.    That  is,  the  above  mentioned  relation- 
ships appear  to  be  linear,  within  the  range  of  our  data. 
Because  of  these  effects,  explicit  "ideal-  ranges  for 
these  variables  cannot  be  given  here. 

Outliers  may  take  many  forms;  they  may  be  outliers  in 
fl^S^L        conditional  distribution  (that  is,  deviations 
from  the  regression  surface) ,  the  unconditional  distri- 
to  Ih2  °^         observed  values,  relative 

to  the  rest  of  the  sample) , -or  both.     Biweighted  regres- 
sion essentially  attempts  to  deal  with  deviations  from 
the  regression  surface  that  are  large,    other  "outliers- 
(and  some  analysts  might  debate  the  propriety  of  that 
label  here)  may  "unduly-  influence  the  regression  fit 
without  necessarily  being  extreme  deviations  from  the 

-I'eipr;,.^''^^^;    ^"^u  °bservations  are  said  to  have  high 

leverage,-  and  another  set  of  diagnostic  tools  is 
required  for  examining  data  with  potential  problems  from 
Sefsch°  "tSk  ^^'^^  ^^'^^  leverage  (see  Hoaglin  and 

?i2''MnSP?''*'ri^''^^''^         important  in  most  research, 
the  NDCS  included,  and  since  the  sampling  properties  of 
biweighted  regression  estimates  are  not  lnaly?iLn? 
tractable  (Gross,  1977),  researchers  with  these  estima- 
atl^  ^^''^  foniething  of  a  dilemma.     OLS  techni- 

ques yield  the  required  tests,  but  their  propriety  or 
accuracy  may  be  questionable,  biweighted  estimates  are 
more  appropriate  point  estimates,  but  their  sampling 
properties  (and  therefore  their  statistical  sigSif ??ance) 
is  unknown.     This  dilemma  was  attacked  in  the  nScS  by  ' 
exploratory  analysis  and  model-building  stages,  checkina 
results  periodically  and  finally  by  comparing  OLS-eltimlted 
fr!  riri?C'%?''*'  biweighted  coefficients.  Resources 
are  rarely,  if  ever,  sufficient  for  checking  all  OLS 
"="lts  step  by  step,  and  it  is  a  moot  poiS?  JJether  an 
observed  biweighted-OLS  difference  is  tl  be  considered 
large  or  important.    Nevertheless  this  technique  proved 
to  be  very  useful  in  the  NDCS:     erroneous  data  were 
scrC^nl^f/      corrected,  and  outliers  were  discovered, 
scrutinized,  and  rejected  from  further  statistical 
dnd  xy S6S • 
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Appendix  1 


APPROPRIATE  WEIGHTS  FOR  CLASS-LEVEL  REGRESSIONS 

Consider  the  "true"  linear  model; 

Y  »  XB  +  e  (A.l) 

where  Y  is  m  x  1,  X  is  m  x  q,  B  is  q  x  1  and  e  "  N(0,  S ) 
where  2]   is  a  diagonal  m  x  m  matrix.     If  we  use  a  diagonal 
weight  matrix  W,  to  estimate  (A.l),   the  weighted-class-level 
residual  sum  of  squares  is: 

SS^  =  (Y  "  x'b)  •  W(Y  -  XB) 

We  define  the  weighted  "hat"  matrix  to  be: 

=  W^/^  X  (X'WX)'"^  X*  W^/^ 

It  is  then  easily  shown  that  both  H     (with  rank  q)  and 

w 

hence  (I  -  H^)   (with  rank  m-q)  are  idempotent  and  that 

X'W^/^d  -  H  )  =  0,   so  that 
w 

SS^  =  (Y  "  XC)*W^/^  (I"H,^)  W^/^   (Y  -  XC) 
does  not  depend  on  C.    Assuming  the  truth  of  (A.l),  we  obtain 
SS^  -  e'W^/2  ^1/2  2) 


or  SS^  =  u'_^u.  (A. 3) 

where  u~N(0,I)  and 

Let  A^,  k»l , 2 , . . .m-q,  be  the  nonvanishing  eigenvalues  of 
Then  the  form  (A. 3)  may  be  rewritten; 

k»l 

where  W^,  k=l , 2 , . . . ^m-r,   are  i.i.d.  N(0,1).     Clearly  SS^ 

is  distributed  as  chi-square  if  and  only  if  ^    =»  1,  l<k<m-r. 


3^43.9 


This  result  is  used  where  we  set  W»I. 

Now  take  W  -  T^/^  so  that         -  (i-h^)  has  ra-q 
eigenvalues  equal  to  0.  Thus, 

SS    =    E     Wf    ~  x„ 

This  result  is  noted  where 

E  =diag  ^  +  ,2  -Z+.Zj^ 

2  in 

In  order  to  calculate  W,  estimates  of       and  must 
be  computed.     This  may  be  accomplished  by  iteratively  cal- 
culating regression  residuals  and  their  variance  components 
until  convergence  is  obtained. 
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Appendix  2 
BIWEIGHTED  REGRESSION 


Background 

Ordinary  least  squares  (OLS)  regression  fitting 
minimizes  the  sum  of  squared  residuals  about  an  estimated 
regression  surface  (hence  the  OLS  label)'.     For  many  years, 
OLS  estimates  have  enjoyed  widespread  usage  and  popularity 
among  data  analysts  for  both  the  relative  ease  with  which 
they  can  be  estimated  and  the  variety  of  circumstances  under 
which  they  may  be  considered  "best". 

Using  high-speed  computers,  OLS  estimates  can  be 
quickly  and  readily  obtained  at  a  minimum  of  expense.  Many 
algorithms  for  deriving  the  estimates  are  currently  available; 
moreover,  all  sophisticated  computer  facilities  have  prepack- 
aged programs  which  will  produce  not  only  the  OLS  estimates 
themselves,  but  a  variety  of  additional  information  for 
evaluating  the  performance  of  the  fitted  surface  (including 
estimates  of  standard  errors,  routine  hypothesis  tests  and 
measures  of  goodness-of-f it) • 

One  of  the  primary  reasons  that  so  much  energy  has 
been  devoted  to  the  derivation  of  techniques  to  produce  OLS 
estimates  to  that  they  are  known  to  have  several  desirable 
statistical  properties.    Among  those  of  importance  are: 

•  Unbiasedness;     Under  the  relatively  mild 
assumption  that  the  error  terms  have  an  expec- 
tation of  zero,  OLS  estimates  are  unbiased; 
that  is  the  expected  value  of  the  OLS  estimate 
is  the  population  regression  coefficient. 

•  Minimum  Variance  (efficiency);     If  one  further 
assumes  that  the  error  terms  are  uncorrelated 
with  constant  variance,  then  OLS  estimates  are 
minimum  variance  among  the  class  of  linear 
unbiased  estimators  (that  is  the  Gauss-Markov 
Theorem) . 


•    Maximum  Likelihood;    if  an  even  stronger 

assumption  is  made  that  the  errors  are  normally 
distributed  (which  encompasses  the  two  previous 
assumptions),  then  OLS  estimators  are  also  the 
maximum  likelihood  estimators. 

If  heteroscedasticity  and/or  dependence  between  observations 
(with  known  structure)  are  present,  a  "generalized"  least 
squares  solution  is  appropriate.    This  amounts  ot  transforming 
the  data  into  a  form  for  which  the  OLS  solution  is  appropriate 
then  the  OLS  estimates  on  the  transformed  data  have  all  the 
desirable  properties  mentioned  above. 

Even  if  heteroscedasticity  is  not  a  problem  and  the 
observations  are  drawn  independently,  however,  certain 
conditions  may  exist  that  can  prove  problematic  for  OLS 
techniques.     For  example,  a  regression  estimated  from  a 
small  sample  that  is  not  normally  distributed  may  give  rise 
to  estimates  that  are  inefficient  relative  to  nonlinear 
estimates.     In  particular,  OLS  estimates  of  location  (a 
class  of  estimators  including  regression  estimators)  are 
susceptible  to  problems  created  by  distributions  that  have 
"thicker"  or  "more  stretched"  tails  than  those  expected 
under  normality  (Hosteller  and  Tukey,  1972,  Ch.  10) . 
"Contaminated"  normal  distributions  can  give  rise  to  this 
problem,     if  a  variable  is  distributed  normally  in  two 
intermixed  and  otherwise  indistinguishable  populations,  one 
very  much  smaller  than  the  other,  but  also  in  which  the 
variance  of  this  variable  is  much  larger,  then  the  type  of 
distribution  described  above  will  result  for  the  population 
as  a  whole. 


Under  these  conditions,  CLS  estimators  are  neither 
robust  nor  resistant.     Resistance  concerns  the  sensitivity, 
or  lack  thereof,  of  particular  obtained  estimates  to  extreme 
changes  in  the  values  of  a  small  number  of  sampled  observa- 
tions.    As  used  here,  robustness  refers  to  robustness  of 
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efficiency;  this  is  the  relative  8 ^.ability  of  the  efficiency 
of  an  estimator  under  a  variaty  of  assumptions  concerning 
the  distribution  of  the  variable  in  the  population  from 
which  the  sample  is  dravm.    Under  normality,  OLS  estimators 
are  efficient  with  respect  to  nonlinear  estimators  such  as 
the  biweight.    Under  the  "thick-tailed"  class  of  distribu- 
tions, however,  certain  nonlinear  regression  estimators 
(like  biweighted  estimates)  are  more  efficient  than  OLS 
estimators . 


Note  that  there  are  some  important  problems  for 
the  estimation  of  a  regression  equation  under  such  conditions 


•    The  departure  from  normality  may  not  be  detected 
or  if  it  is,   it  may  be  ignored.     The  resulting 
"thick-tailed"  distribution  is  still  unimodal, 
symmetric,  and  "bell-shaped.  ** 


•    Usual  procedures  for  examining  residuals  are 
unlikely  to  spot  the  problem.     "Thicker"  tails 
suggest  that  a  higher  proportion  of  residuals 
will  fall  into  extreme  ranges  than  would  be 
expected  under  Gaussian  assumptions,  but  these 
"f ringe-liers"  are  not  likely  to  stand  out  as 
outliers. 


•    Not  only  are  OLS  estimates  of  regression  coeffi- 
cients inefficient,  but  the  usual  (OLS)  estimate 
of  their  sampling  variances  are  inaccurate. 
Hypothesis  tests  based  on  OLS  estimators,  then, 
are  suspect,  and  (for  instance)  standard  errors 
reported  in  the  output  from  standard  statis- 
tical analysis  computer  packages  (e.g.,  SPSS, 
BMD,  DATATEXT)  are  simply  wrong. 


Distributions  like  the  "contaminated"  normal 
appear  to  be  fairly  common  in  social  science  research  (see 
also  Hosteller  and  Tukey,  1972,  Ch.  1).     In  cases  like  the 
NDCS,  where  class-  and  center-level  regression  models  may  be 
estimated  on  subsamples  ranging  in  size  (roughly)  from  20  to 
140,  the  relative  nonresistance  and  nonrobustness  of  OLS 


318 


estimates  may  be  problematic.  Biweighting  is  one  way  to 
approach  the  problem  of  estimation  under  such  conditions 
(Mosteller  and  TuJcey.  1972.  Ch.  10.   14-16;  Andrews  et  al.. 


1972) . 

2*  piweiqhted  Regression 


Simply  stated,  the  biweight  is  a  mechanism  for 
assigning  weights  to  observations  (or  cases)  on  the  basis  of 
the  magnitudes  of  their  deviations  from  a  location  estimate 
(e.g..  a  regression  surface).     Formally,  the  weight  for 
observation  (or  case)  i  is: 


w    =  (1  -  nf^^j^2)2  (Y^  -  Y*)2  ^ 

^  (cS)2  (cs)2 

=  0  otherwise 

and  yi  is  the  observation  of  y  for  case  i;  y*  is  some 
estimate  of  location;  c  is  an  arbitrary  constant  (often  6  or 
9);  and  S  is  an  estimate  of  spread  or  scale.     Typically,  y* 
and  S  will  be  robust,  resistant  estimates  themselves  (e.g.. 
a  median  or  a  biweighted  mean;  and  the  median  absolute 
deviation  or  one-half  the  distance  between  the  25th  and  75th 
percentiles  on  the  sample  cumulative  distribution  function, 
respectively).     Clearly,  the  more  that  Y.  deviates  from 
y*.  the  smaller  w.  will  be;  at  some  point-determined  by 
the  values  of  c  and  S-this  deviation  can  become  so  large 
that  the  weight  assigned  that  case  is  zero  (effectively,  the 
observation  is  discarded  as  an  outlier). 

It  is  clear  that  arriving  at  a  biweighted  estimate 
involves  iterations;  the  weights  at  one  fitting  of  a  regression, 
for  instance,  are  used  to  establish  a  fitted  surface  (gener- 
ating y*),  and  S  (e.g..  the  median  absolute  deviation). 
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Which  in  turn  will  define  new  weights  for  the  next  fitting 
Hopefully  (and  presumably)  the  process  converges  according 
to  some  preset  criteria  (as  was  the  case  in  the  NDCS); 
alternatively,  the  number  of  iterations  to  be  done  may  be 
set  a  priori* 
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CHAPTER  ONE;  OVERVIEW 


Day  care  centers  are  complex  environments  in 
which  a  variety  of  factors  may  join  together  to  influence  a 
child' s  behavior  and  development.     For  example,  careg ivers 
may  affect  children's  growth  by  the  types  and  amounts  of 
interaction  they  provide.     The  range  of  behavior  children 
display  may  be  contingent  upon  the  kinds  of  activities  made 
available  to  them  as  well  as  upon  the  size  of  the  group 
during  those  activities.     Personal  qualities  of  the  director, 
physical  characteristics  of  the  center  and  programmatic 
elements  of  the  center  (developmental  emphasis  and  classroom 
curriculum)  are  clearly  important  to  the  dynamics  of  the  day 
care  center  and  thus  may  be  associated  with  events  a  child 
encounters  daily  and  with  their  impacts  on  the  child. 

The  analysis  of  the  relationships  between  observed 
behavior  of  caregivers  and  children  (classroom  process)  and 
PSI  and  PPVT  test  scores  (one  important  outcome  for  children) 
was  undertaken  with  two  goals  in  mind;  first,  to  identify 
contributing  factors  and  second,  to  describe  the  linkages 
between  them.     For  convenience,  this  analysis  is  hereafter 
referred  to  as  process-outcome  analysis. 

Each  of  the  variables  included  in  the  process- 
outcome  analysis  has  been  examined  separately  in  individual 
analyses  with  the  major  policy  variables — staff/child  ratio, 
group  size  and  caregiver  qualifications.     The  primary  focus 
here,  therefore,  is  not  to  repeat  these  main  effects  analyses, 
but  to  examine  the  interrelationships  among  these  different 
dimensions  with  the  intention  of  forming  an  overall  picture 
of  day  care.     For  detailed  descriptions  of  the  separate 
analyses  of  the  major  components  of  the  process-outcome 
analysis — the  Adult-Focus  Instrument  (AFI),  the  Child-Focus 
Instrument  (CFI),  and  the  cognitive  test  scores — the  reader 


is  referred  to  the  individual  papers*  in  this  volume  or  the 
summaries  in  Volume  ll. 


The  major  findings  of  this  analysis  fall  into  two 
categories:     those  dealing  with  the  activity  of  the  children 
in  care,  and  those  dealing  with  the  caregiver's  interaction 
with  the  children.     in  centers  with  higher  cognitive  gains, 
children  are  more  frequently  involved  in  tasks.     They  move 
about  the  room  with  a  purpose,  less  often  wandering  aimlessly, 
They  engage  in  more  thoughtful  reflection  about  tasks, 
receive  more  input  from  adults  about  their  activities,  and 
cooperate  more  with  other  children.     Thus,  the  cluster  of 
findings  on  child  activity  shows  a  clear  relationship 
between  concentrated  intentional  child  behavior  and  higher 
cognitive  gains.     This  finding  can  be  connected  to  other 
NDCS  findings  about  group  size  in  that  smaller  groups  were 
associated  with  more  of  these  task-oriented  behaviors  on  the 
part  of  the  children. 

Higher  cognitive  gains  were  also  found  in  centers 
where  there  was  an  emphasis  on  cognitive  tasks,  i.e.,  where 
the  director  felt  that  child  learning  was  an  important  part 
of  day  care.     Also,  in  centers  where  the  director's  philo- 
sophical orientation  resulted  in  a  move  away  from  whole-group 
activities,  and  where  the  caregivers  worked  with  medium- 
rather  than  large-sized  groups,  higher  gains  were  found  and 
certain  caregiver  behaviors  predominated.     In  particular, 
caregivers  in  these  centers  interacted  more  with  the  children: 
They  interacted  socially  much  more  than  they  passively 
observed  the  children;  they  engaged  in  more  management  of 
the  children,  giving  directions  and  correcting  mistakes  more 
often.    These  findings  on  the  interactiveness  of  caregivers 
may  also  be  connected  to  the  findings  on  group  size  cited  in 


*See  Goodson,  1980;  Connell,  1980;  Goodrich,  1980b  for  further 
information 


other  papers.     Interactiveness,  too,  occurs  more  often  in 
centers  with  smaller  group  sizes.    Thus,  a  clear  picture 
emerges  of  centers  with  higher  cognitive  gains.    They  have 
smaller  group  sizes,  the  children  are  more  often  engaged  or 
involved  in  activities,  and  the  caregivers  interact  with  the 
children  more  frequently  in  both  a  social  and  managerial 
role. 
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CHAPTER  TWO;     DATA  DESCRIPTION 


Many  different  types  of  variables  were  examined  in 
the  process-outcome  analysis  and  contributed  to  the  findings 
cited  in  the  previous  chapter:     (a)   those  relating  to  the 
processes  of  day  care— behaviors  displayed  by  both  children 
and  caregivers;   (b)  those  pertaining  to  the  outcomes  for 
children  in  day  care;   (c)  those  characteristics  of  day  care 
centers  which  are  presently  or  potentia-lly  regulatable;  and 
finally,   (d)  covariables,  which  were  to  be  used  to  set  aside 
the  effects  of  possibly  confounding  factors  such  as  age,  sex 
and  race.    A  brief  description  of  the  sources  of  these  data 
will-b"^  given  here  along  with  a  discussion  of  the  types  of 
information  each  provided. 

Adult-Focus  Instrument 

The  Adult-Focus  Instrument  (AFI)   includes  a 
Physical  Environment  Inventory,  which  describes  space, 
materials  and  equipment  in  the  classroom;  a  Classroom 
Snapshot,  which  describes  general  activity  patterns  at  a 
single  point  in  time;  and  a  Five-Minute  Interaction  (FMI) 
record,  which  describes  the  behavior  of  a  particular  care- 
giver in  detail.     The  Five-Minute  Interaction  data  are  of 
primary  interest  here. 

An  FMI  record  takes  the  form  of  "sentences" 
identifying  an  actor  (who),  the  object  of  the  action  (to 
whom),  the  nature  of  the  action  (what),  and  the  style  of  the 
action  (how).     During  each  five-ninute  observation  period, 
up  to  63  sentences  could  be  recorded,  the  actual  number 
being  left  to  the  observer.     For  each  lead  teacher  in  the 
study,  eighteen  FMI's  were  typically  recorded.     TO  WHOM 
codes  include  objects  such  as  teacher,  single  child,  small 
group  (defined  as  2-7  children),  medium  group  (8-12  children) 
and  large  group  (13  or  more  children).     WHAT  codes  denote 
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such  behaviors  as  commands,  instructs,  praises,  observes  and 
comforts.     The  proportion  of  time  each  WHAT  and  TO  WHOM  code 
was  recorded  was  used  in  analysis,  rather  than  the  raw 
frequency  of  occurrence.     This  was  necessary  because  the 
number  of  sentences  coded  by  each  observer  for  each  FMI 
varied.     Proportions,  then,  reflect  the  proportion  of  total 
time  spent  in  a  given  activity   (for  the  WHAT  codes),  r.nd  the 
proportion  of  total  time  the  caregiver's  attention  was 
focused  towards  a  particular  object  (for  the  TO  WHOM  codes). 

HOW  codes  are  modifiers  such  as  touch,  non-verbal, 
negative,  positive  and  happy.     The  HOW  codes  were  not 
included  in  this  analysis,  however.     This  is  partly  because 
the  HOW  codes  were  only  optionally  noted  by  observers,  but 
more  importantly  because  the  meaning  of  the  HOW  codes  is 
likely  to  be  highly  conditional  upon  the  WHAT  and  TO  WHOM 
codes  they  modify.     It  is  basically  through  the  WHAT  and  TO 
WHOM  codes,  then,  that  information  was  obtained  relating  to* 
caregiver  behavior.     A  list  of  the  AFI  codes  analyzed 
appears  in  Appendix  A. 

Child-Focus  Instrument 

The  Child-Focus  Instrument   (CFI)  consists  of  a 
set  of  codes  which  provide  a  fairly  fine-grained  description 
of  child  behavior  in  the  day  care  setting.     The  CFI  was 
administered  during  a  20-minute  observation  period  divided 
into  100  12-second  coding  intervals   (or  100  frames). 
Observers  were  provided  with  timers  that  clicked  every  12 
seconds  and  were  instructed  to  record  what  was  happening  to 
a  selected  focus  child  at  the  time  of  each  click.     For  each 
coding  interval,  a  record  was  made  of  the  specific  activity 
in  which  the  child  was  engaged  and  the  object  of  the  child's 
attention.     A  list  of  the  CFI  activity  and  attention  codes 
used  in  the  process-product  analysis  appears  in  Appendix  A. 


As  with  the  API,  for  each  20-minute  observation  period,  a 
score  on  each  activity  and  object  code  was  computed  by 
taking  the  proportion  of  frames  for  which  the  specific 
activity  (or  object)  was  coded.    The  CPI  was  administered  to 
target  children  in  the  morning  hours  only,  during  free  play 
and  teacher-directed  activities.     The  activity  codes  included 
in  the  CPI  can  be  thought  of  both  as  descriptors  of  classroom 
process  arid  also  as  child  behavior  measures.     Por  example, 
the  amount  of  time  spent  in  open-ended,  expressive  activities 
is  indicative  of  classroom  process,  while  other  codes  relate 
more  directly  to  child  behaviors  (e.g.,  gives  opinions,  adds 
prop  or  idea) . 

Cognitive  Tests 

Two  measures  of  school  readiness  were  used  in  the 
NDfcS:     the  Preschool  Inventory  (PSI)  and  the  Peabody 
Picture  Vocabulary  Test   (PPVT) .     The  ppvT  is  principally  a 
measure  of  receptive  language  functioning;   the  psI  is 
designed  to  measure  a  range  of  knowledge  and  skills  including 
the  child's  knowledge  of  colors,  shapes,  sizes  and  spatial 
relationships.*    Analysis  has  focused  upon  children's  fall- 
to-spring  gains  on  these  two  tests.     The  gain  scores  used 
were  not  simple  differences  of  spring  and  fall  scores,  but 
were  generalized  gain  scores,  adjusted  so  as  to  avoid  well- 
known  technical  problems  with  simple  difference  scores.** 
PSI  and  PPVT  gain  scores  were  used  as  two  primary  child 
outcome  measures  in  the  process-outcome  analysis. 


*The  PSI  and  PPVT  and  their  psychometric  properties  are 
described  in  more  detail  in  Bache,  1980b. 
**Por  additional  information  on  the  adjustment  technique 

see_Goodrich  and  Singer,  1980.  These  scores  are  essentially 
residual  gain  scores  with  Lord-Porter  corrections  1^^'^"^ 
attenuation. 
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Child  Development  Associates  Checklist 


The  Child  Development  Associates  (CDA)  Checklist 
is  an  observation  instrument  containing  235  items,  developed 
by  SRI  International  to  record  caregiver  behavior  relevant 
to  categories  of  competence  specified  in  the  CDA  certifica- 
tion system.    The  Checklist  was  filled  out  by  observers 
following  the  2-  to  3-hour  Adul t-Focus  Observations.  An 
extensive  analysis  of  the  data  led  to  identification  of  four 
CDA  constructs:     Child  Orientation,  Class  Management, 
Resources  and  Environment.     in  addition,  an  overall  CDA 
rating  ^as  assigned  to  each  caregiver.     Each  of  these  is 
defined  in  Appendix  A. 

Policy  Variables 

Analysis  in  the  NDCS  has  focused  primarily  upon 
the  following  regulatable  characteristics. 

•  Number  of  Caregivers:     the  total  number  of 
caregivers  assigned  to  each  classroom. 

•  Group  Size;     the  total  number  of  children 
assigned  to  a  class  or  to  a  principally 
responsible  caregiver. 

•  Staff/Child  Ratio;     number  of  caregivers 
divided  by  group  s i ze . 

•  Caregiver  Qualifications;     total  years  of 
formal  education,  presence  or  absence  of 
specialized  preparation  related  to  child  care, 
day  care  experience  (both  prior  to  current  job 
and  time  in  current  center)  . 

Each  of  the  above  variables  was  examined  earlier  in  analyses 
of  the  CFI,  AFI  and  cognitive  tests,  and  their  results  are 
reported  elsewhere  in  Volume  IV.     The  purpose  of  including 
them  in  the  process-outcome  analysis  was  to  investigate 
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whether  or  not  the  conclusions  found  in  these  analyses  could 
be  altered  by  the  addition  of  other  types  of  information  in 
the  model,     a  simple  e-^ample  will  illustrate  this  idea. 
Analysis  has  shown  that  there  is  a  strong  association 
between  group  size  and  cognitive  gain  scores.     Suppo  :  that 
when  information  regarding  caregiver  behavior  was  included 
in  the  analysis,  it  was  found  that  caregivers  were  more 
interactive  in  small  groups  and  in  addition,  more  interactive 
caregivers  were  found  in  classrooms  where  children  had 
higher  cognitive  gain  scores.     m  this  situation,  it  would  be 
difficult  to  separate  out  the  effects  of  caregiver  behavior 
and  group  size  upon  gain  scores,  particularly  since  they  may 
all  be  linked  in  a  causal  chain.     Examination  of  these 
variables  in  the  context  of  such  an  inclusive  analysis, 
therefore,  allowed  investigation  of  rival  hypotheses. 
Appendix  A  contains  a  list  of  the  precise  variables  used  in 
analysis. 

Director  Qualifications 

These  variables  pertain  to  the  education,  experience 
training  and  degree  of  specialization  of  center  directors. 
A  list  of  variables  examined  appears  in  Appendix  A. 

Physical  Environment 

Information  was  taken  from  center  space  plans 
regarding  the  amount  of  space  available  to  children. 
Several  measures  were  constructed: 

•  Homeroom;  play  space  designated  as  belonging 
to  the  target  class  of  children. 

•  Class  Space;  center  space  in  daily  use  bv 
target  class.  '  ' 

•  Child  space:  all  space  in  center  used  daily 
by  any  of  the  target  classes. 
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•  indoor  Space;  all  center  s^jace  dedicated  to 
day  care  use. 

•  Outdoor  Space;  space  designated  as  play  area 
for  the  day  care  children. 

Center  Philosophy  and  Program  Orientation 

The  philosophy  of  a  center  and  its  general  approach 
to  the  care  and  education  of  young  children  can  have  profound 
effects  on  the  dynamics  of  a  classroom.     During  Phase  II, 
data  on  center  philosophies  and  curricula  were  gathered  by 
means  of  interviews  with  directors,  caregivers  and  center 
secretaries.*    A  program  typology  was  then  developed  on  the 
basis  of  this  information.     Programs  were  first  sorted  into 
two  mutually  exclusive  (but  not  exhaustive)  categories, 
depending  on  whether  they  emphasized  the  individual  child  or 
the  group.     Individual  emphasis  implied  stress  on  independence, 
self-reliance,  learning  at  the  child's  own  pace  and  making 
the  child  feel  important  or  special;  group  emphasis  implied 
stress  on  sharing,  cooperation,  getting  along  with  others 
and  interaction  between  staff  and  children. 

Beyond  this  broad  distinction,  centers  were  cat- 
egorized according  to  other  program  emphases.     The  latter 
categories  were  not  mutually  exclusive;  centers  could  be 
placed  in  several  categories  i f  their  philosophies  seemed  to 
involve  multiple  emphases.     These  additional  descriptive 
categories  were; 

•  Ethnic  and/or  Religious  Emphasis ;  a ppl i ed 

to  centers  that  stressed  spiritual  development 
or  the  importance  of  learning  to  appreciate 
one's  own  culture. 

•  Guidance  Emphasis;  applied  to  centers  where 
staff  stressed  love,  warmth,  security,  under- 
standing or  a  "homey"  atmosphere. 


♦Center  secretaries  were  provided  by  the  NDCS  to  each  center 
to  assist  in  routine  de  a  collection. 


•  Protective  Emphasis;  applied  to  centers  that 
saw  themselves  as  principally  caring  for  childre 
basic  needs  in  order  to  free  their  parents  for 
work  or  other  activities, 

•  Bei.b/ioral  Supervision  Emphasis;  applied  to 
centers  that  stressed  obedience,  discipline, 
manners  and  adult  supervision  and  control. 

•  Cognitive  Emphasis:  applied  to  centers  where 
staff  stressed  such  activities  as  language 
stimulation  or  teaching  ABC's  and  number 
concepts,  and  where  the  day  care  classroom 
was  described  as  preparation  for  the  grade 
school  environment. 


Covariablec 


These  variables  were  to  be  used  in  regressions 
to  control  for  the  effects  of  possibly  confounding  factors, 
such  as  socioeconomic  status  and  race.     The  intent  here  was 
not  to  estimate  the  effects  of  these  variables,  but  rather 
to  adjust  for  them  in  some  manner  if  they  were  found 
to  be  associated  with  any  of  the  measures.     Covariables  were 
selected  fo-  use  in  the  process-outcome  analysis  on  the 
basis  of  whether  or  not  they  were  examined  in  each  of  the 
three  main  effects  analyc:js.     A  list  of  the  available 
covariables  appears  in  Appendix  A. 
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CHAPTER  THREE;     ANALYTIC  ISSUES 


Before  delving  into  the  actual  data  analysis,  it 
is  necessary  to  address  four  key  concerns  regarding  the 
analysis:     (1)  the  unit  of  analysis,   (2)  the  sample  defin- 
ition,  (3)  the  approach  taken  to  analysis,  and   (4)  construct 
development. 

Unit  of  Analysis 

Choice  of  the  appropriate  unit  of  analysis  is 
always  a  key  decision  in  any  investigation  involving  hier- 
archical (nested)   levels  of  data.    Variables  available  for 
the  process-outcome  analysis  exist  at  three  levels  of 
aggregation:     child,  class  and  center.*    Any  single  time 
point  measurement  at  a  lower  level,  such  as  CFI  or  API  data, 
can  always  be  aggregated  to  a  higher  level  for  analysis. 
Generalized  gain  scores  for  the  cognitive  test  data,  however 
can  only  be  examined  at  the  child  and  center  levels.  This 
is  due  in  part  to  the  fact  that  over  the  day  care  year, 
children  within  a  given  center  frequently  switched  class- 
roons,  making  it  difficult  to  create  classroom  level 
change  measures  without  severely  reducing  the  sample  size. 

Child  Level 

Analysis  was  not  performed  at  the  child  level  for 
several  reasons.     Among  the  various  types  of  data  of  major 
interest  here,  only  two  exist  at  the  child  level:  child 
behavior  data  (CFI)  and  cognitive  test  scores.  Variance 
components  analyses  conducted  on  CFI  data  suggested  that  it 
is  more  reasonable  to  think  of  the  instrument  as  a  measure 
of  classroom  and/or  center  characteristics  than  as  a  measure 

*It  is  important  to  note  that  the  class  level  and  teacher 
level  are  virtually  synonomous;  with  infrequent  exceptions 
the  classrooms  observed  had  only  one  lead  teacher. 
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of  individual  child  behavior.      That  is,  the  CFI  should 
not  be  considered  a  measure  of  child  traits,  which  could  in 
turn  be  associated  with  test  scores,  but  rather  as  one 
measure  of  overall  classroom  (or  center)  process.     Only  the 
cognitive  test  scoJres  and  the  child-level  covariables, 
therefore,  are  considered  child-level  data.    However,  the 
previously  established  lack  of  within-center/class  effects 
for  the  cognitive  test  scores  insures  that  aggregation 
bias  effects  are  not  problematic;  furthermore,  it  suggests 
that  the  appropriate  unit  of  analysis  is  the  more  aggregated 
level.*    On  the  basis  of  these  arguments,  then,  no  process- 
outcome  analyses  wete  conducted  at  the  child  level. 

Class  Level 

The  class  level  is  the  next  level  of  analysis. 
Several  main  effects  analyses  were  conducted  at  this  level, 
most  notably  the  analysis  of  the  Child-Focus  and  Adult-Focus 
Instruments.     Had  the  generalized  cognitive  change  scores 
been  available  for  nearly  all  children  at  the  classroom 
level,  the  majority  of  the  process-product  analyses  might 
have  been  conducted  at  this  level,  but  classroom  organiza- 
tional changes  were  so  frequent  that  too  few  children  were 
present  in  the  same  class  at  both  testings.     Since  observa- 
tion data  were  available  at  the  class  level,  however,  the 
linkages  between  adult  behavior  and  child  behavior  were 
investigated  at  class  level.     Included  in  this  portion  of 
the  process-outcome  analysis,  then,  are  all  CFI  and  AFI 
data,  as  well  as  the  major  policy  variables  and  classroom- 
level  averages  of  the  child-  and  teacher-related  covariables. 
No  center-level  data,  including  director  qualifications  and 
center  philosophy,  were  included  in  this  class-level  analysis, 
however. 


*This  result  and  several  other  statistical  considerations 
in  the  choice  of  analysis  unit  are  discussed  in  more 
detail  in  Singer,  Affholter,  and  Goodrich,  1978. 
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Center  Level 


All  remaining  linkages  in  the  process-outcome 
analysis  have  been  investigated  at  the  center  level. 
For  the  most  part,  these  take  the  form  of  combined  and 
individual  associations  between  the  PSI  and  PPVT  general- 
ized gain  scores  and  adult  behaviors,  child  behaviors, 
policy  variables,  CDA  variables,  director  qualifications, 
physical  environment  (3ata  and  center  philosophy  and  program 
orientation  information,     in  addition  to  the  justification 
of  analyzing  gain  scores  at  the  center  level  based  upon  the 
relative  instability  of  classes  over  the  day  care  year,  a 
rationale  for  this  approach  can  be  mounted  on  the  basis  of 
the  requirement  for  unbiased  hypotheses  testing.  Moreover, 
as  previously  cited,  the  absence  of  significant  child-level 
covariable  model   (i.e.,  within-center  or  within-class 
effects)  suggests  that  aggregation  effects  are  not  proble- 
matic with  a  center-level  analysis. 


Sample  Definition 

Once  the  ynit  of  analysis  issue  has  been  treated, 
the  next  concern  is  to  determine  which  data  should  be 
aggregated  to  the  chosen  levels.     For  example,  should 
all  caregivers  observed  be  included  in  analysis — teachers 
and  aides; — or  should  attention  be  restricted  only  to  lead 
teachers?    The  sample  definition  may  be  outlined  as  follows. 


Aduln  Pehavior 


Data  on  lead  teachers  only,  rather  than  on  aides 

or  on  all  caregivers   (teachers  and  aides)  are  used  in  NDCS 

analyses  of  adult  behavior.    The  aides  for  whom  observations 

were  made  constitute  neither  the  total  population  of  aides 

in  the  centers  under  study,  nor  a  random  sample  of  these 
2 

aides.  Under  these  circumstances,  aggregating  the  data 
accross  teachers  and  aides  could  lead  to  less  meaningful 
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variables  than  is  desirable.     Hence,  only  data  on  lead 
teachers  is  used  in  the  process-outcome  analysis. 

A  second  concern  is  whether  fall  or  spring  data  or 
both  are  to  be  analyzed,     m  the  fall  data  collection,  race 
of  observer  and  race  of  caregiver  were  confounded  to  some 
extent;  this  situation  was  remedied  by  the  assignment  of 
bi racial  pairs  of  observers  to  teachers  in  the  spring,  in 
addition,  previous  analysis  of  the  API  has  revealed  some 
differences  between  behavior  patterns  in  the  fall  and 
spring.    The  process-outcome  analysis  has  therefore  concen- 
trated on  spring  data  which  is  believed  to  be  less  influenced 
by  observer  and  "start-up"  effects. 

Child  Behavior 

The  Child-Focus  Instrument  was  administered  once 
to  children  during  free  play,  once  during  teacher-directed 
activity  and  a  third  time  during  a  randomly  chosen  activity 
type.     Differences  were  found  in  CFI  code  frequencies  across 
activity  types,  and  hence  care  must  be  taken  when  aggregating 
observations  over  teacher-directed  and  free  play  a  ,  '  .-. 

In  the  interest  of  describing  child  behavior  in' the  ci:>i?s;--oo.. 
with  as  few  variables  as  possible,  however,  the  observatir.-s 
were  combined  across  both  activity  periods  for  .   e  in  the 
process-outcome  analysis.     These  combined  variables  bettftv 
reflect  the  qverall  behavior  patterns  across  all  activity 
types  during  the  day  care  day. 

In  addition  to  this  analysis,  a  separate    v.  ..lysis 
linking  CFI  teacher-directed  data  with  AFI  lead  teacher  data 
was  conducted.    As  with  the  AFI  data,  only  observations  made 
in  the  spring  were  examined.     This  analys:-  is  described  in 
Connell  (1980). 


Child  Test  Sco res 


Children  had  to  have  both  a  valid  pretest  and 
post-test  for  either  the  PSI  or  PPVT  as  well  as  valid  CFI 
data  to  be  included  in  analysis.     It  was  pot  n-cfsT assary  to 
have  valid  test  scores  for  both  tests,  however,,  and  hence 
the  sample  of  children  for  the  PSI  is  slightly  different 
from  that  for  the  PPVT.     In  addition,  only  children  whose 
race  was  reported  as  white  or  black  were  exairLied;  all 
children  reporting  race  as  "other"  were  omitted  from  analysis 
(less  than  4  percent  of  all  children). 

Approach  to  Analysis 

With  the  unit  of  analysis  deci.-rlons  completed  ind 
the  sample  definition  in  mind,  an  outline  of  the  ana3:;t:?c 
approach  nay  now  be  specified.    The  first  i5tac,e  of  ^T^ilysis 
involved  wi  thin-instrument   (API  and  CFI)  dalH  r-^r^ucV  -jn  at 
the  class  level.    Due  to  the  number  of  variables  vviJllable 
from  each  of  these  sources,  it  was  necessary  to  sfuoy 
the  correlations  among  them  to  attempt  to  reduce.  '::he 
information  contained  in  the  data  to  as  f-cw  variables  as 
possible.     A  large  portion  of  this  type  of  evamiiation  had 
already  been  done  in  the  main  effects  analysis  of  each 
instrument.     Since  the  sample  definitiori  uas  slightly 
different  in  the  process  outcome  analY^^is  than  it  was  in  the 
individual  main  effects  analysis,  however,  it  was  necessary 
to  extend  this  investigation. 

Once  the  information  contained  in  each  of  the 
observation  instruments  was  reduced  r^own  to  a  manageable 
number  of  variables,  linkages  between  child  behaviors  (CFI) 
and  adult  behaviors  (AFI)  WL^re  examineo  at  the  class  level. 
This  is  the  first  major  aspect  of  the  rocess-outcome 
analysis.    The  second  portion  of  the  analysis  was  the 
exploration  of  linkages  among  cognitive  test  scores,  child 
behaviors,,  adult  behaviors,  poll;:y  variables  and  other 
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regulatable  center  characteristics  conducted  at  the  center 
level.    The  following  sections  of  this  chapter  discuss  the 
data  reduction  process.    The  next  chapter  reports  the 
linkages  among  instruments. 

Construct  Development 

In  the  first  step  of  the  analytic  process,  the 
Child-Focus  and  Adult-Focus  instruments  were  examined  indivi- 
dually in  an  attempt  to  reduce  the  number  of  variables  to  a 
small  subset  of  major  variables.    The  results  of  this 
process  are  described  below  for  each  instrument. 

Examination  of  the  Child-Focus  Instrument 

The  Child-Focus  Instrument  has  been  used  in  the 
NDCS  to  provide  a  fairly  fine-grained  description  of  child 
behavior  in  the  day  care  setting.     Often,  however,  the 
description  it  produced  could  be  considered  too  detailed,  in 
that  it  is  very  difficult  to  distinguish  many  of  the  fifty- 
four  individual  codes  from  each  other.     As  a  result,  examina- 
tion of  the  separate  codes  could  produce  a  severely  distorted 
picture  of  child  behavior  in  day  care.     For  example,  the  two 
codes  CONSIDERS  and  ADDS  PR'JP  both  reflect  active,  involved 
behavior  on  the  part  of  children;  however,  it  is  very 
difficult  for  observers  to  differentiate  between  them. 
Classrooms  that  are  actually  characterized  by  high  levels 
of  this  type  of  behavior,  then,  may  exhibit  only  small  to 
medium  amounts  of  each  individual  activity.     To  alleviate 
this  problem,  certain  codes  have  been  combined  to  form 
macro-codes.    All  the  codes  that  refer  to  a  child  receiving 
information,  praise  or  other  comments  from  adults  have  been 
grouped  together  under  the  one  RECEIVES  INPUT  code,  for 
example.     Certain  of  the  codes  that  appear  under  the  CFI 
heading  in  Appendix  A,  then,  are  actually  combinations 
of  several  individual  codes  (e.g.,  OPEN  ACTIVITY,  CLOSED 
ACTIVITY,  COOPERATES).     For  a  discussion  of  how  these  macro- 
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codes  were  constructed,  the  reader  is  referred  to  the  CFI 
main  effects  analysis  (Connell,  1980). 

Although  this  type  of  data  reduction  decreased 
the  number  of  variables  necessary  for  analysis,  it  did  not 
eliminate  all  of  the  redundant  information  contained  in  the 
data.     That  is,  it  was  possible  to  reduce  the  data  set 
further  by  studying  the  correlations  among  the  various  CFI 
codes,  and  then  grouping  codes  according  to  those  relation- 
ships which  made  sense  substantively.     Table  3.1  displays 
the  correlations  among  the  CFI  codes  included  in  the  process- 
outcome  analysis.     On  the  basis  of  the  correlations  contained 
in  the  top  three  sections  of  Table  3.1,  three  macro-codes 
were  constructed  for  the  CFI.     Due  to  the  relatively  high 
correlation  between  CONSIDERS  and  ADDS  PROP   (.30),  as  well 
as  the  previously  mentioned  problem  of  differentiating 
between  these  two  behaviors,  the  two  codes  were  summed  into 
the  macro-code  REFLECTION/INNOVATION.     Once  these  two  codes 
were  combined,  it  became  apparent  that  classrooms  which  were 
characterized  by  a  high  degree  of  considering,  comtemplating 
and  adding  props  were  also  characterized  by  much  lower 
levels  of  wandering.     (Note  that  the  correlation  between 
REFLECTION/INNOVATION  and  WANDERS  is  -.26.)     To  condense 
the  information  contained  in  these  variables,  another  new 
variable  was  created  as: 

INDIFFERENCE  =  WANDERS  -  (REFLECTION/INNOVATION) 

This  measure  can  be  thought  of  as  the  balance  in  the  class- 
room between  children  wandering  around  as  opposed  to  partici- 
pating in  thoughtful,  creative,  problem-solving  activity.* 

The  third  macro-code  was  a  combination  of  OPEN 
ACTIVITY  and  CLOSED  ACTIVITY: 

CLASS  STRUCTURE  =  OPEN  ACTIVITY  -  CLOSED  ACTIVITY. 

♦Although  TASK  PERSISTENCE  is  also  highly  correlated  with 
several  veriables,  the  actual  meaning  of  this  code  is 
unclear,  and  hence  it  was  not  included  in  any  macro-code. 
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This  code  describes  the  balance  in  the  classroom  between 
unstructured  and  structured  activity.    Though  it  is  a 
description  of  child  behavior,  it  come  the  closest  of  the 
CPI  codes  to  describing  the  organization  of  the  children 
into  types  of  activities. 

An  additional  note  should  be  made  here  concerning 
the  internal  consistency  of  the  CFI.     Examination  of  Table 
3.1  indicates  that  the  information  contained  within  the 
instrument  can  still  be  summarized  with  far  fewer  variables 
than  those  listed.     Principal  components  analysis  was 
employed  to  try  to  condense  the  information  further;  however, 
the  inability  to  ascribe  precise  meanings  to  each  of  the 
components  suggested  that  retaining  the  original  variables 
would  be  a  wise  course  of  action.     Due  to  the  high  degree  of 
correlation  among  many  of  the  variables,  however,  it  is 
important  to  note  that  the  use  of  an  individual  code  (or 
macro-code)   represents  not  only  that  specific  behavior,  but 
also  acts  as  a  proxy  for  a  variety  of  behaviors  with  which 
it  is  correlated.     For  example,  the  codes  RECEIVES  INPUT, 
ATTENTION  TO  ADULT  and  CLASS  STRUCTURE  are  all  quite  highly 
correlated;  any  of  them  can  be  used  to  characterize  classes 
where  the  children  receive  a  large  amount  of  input  from 
adults  and  hence  focus  their  attention  to  adults  a  large 
proportion  of  the  time,  or  to  distinguish  between  classes  in 
which  activities  tend  to  be  closed,  structured  ones   (such  as 
teaching,  instruction)  as  opposed  to  open-ended,  free  play 
activities.     That  is,  the  variables  on  the  CFI  tend  to 
cluster  together  in  several  small  groups  which  can  be 
thought  of  as  indicating  overall  patterns  of  child  behavior. 

Examination  of  the  Adult-Focus  Instrument 

The  Adult-Focus  Instrument  categorizes  caregiver 
behavior  in  terms  of  a  set  of  codes  that  are  fairly  self- 
explanatory   (e.g.,  COMMANDS,  CORRECTS,  INSTRUCTS).     It  also 
records  whether  trii  caregiver's  behavior  was  directed  to 
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other  adults,  a  single  child,  a  small  group  (defined  as  a 
group  of  2  to  7  children),  a  medium  group  (8  to  12  children), 
or  a  large  group  (13  or  more  children).    Although  the  codes 
contained  in  the  API  may  reflect  relative^  distinct  behaviors, 
analysis  has  suggested  that  some  variable:?  should  be  combined 
to  form  broader  descriptions  of  caregiver  bCiiavior. 


TO  WHOM  codes  with  measurements  of  group  size,  staff  count 
and  staff/child  ratio  from  three  different  sources:  observa- 
tions, the  API  and  the  CPI,     The  TO  WHOM  codes  reflect  the 
proportion  of  time  caregivers  direct  their  attention  to  one 
of  five  distinct  objects.     Two  types  of  correlation  patterns 
may  be  found  among  these  attention  codes:     those  which  reflect 
the  manner  in  which  the  variables  were  constructed,  and  those 
which  reflect  actual  caregiver  behavior  patterns.     The  former 
pattern  occurs  because  each  caregiver  has  only  a  finite  amount 
of  time  which  can  be  distributed  among  the  five  objects,> 
Caregivers  who  often  focus  their  attention  to    one  or  two  of 
these  objects  can  not  also  focus  their  attention  towards  the 
remaining  objects,  and  as  a  consequence,  many  of  the  TO  WHOM 
codes  are  negatively  correlated.    Whereas  this  type  of  correla- 
tion pattern  is  an  artifact  of  the  "limited  resources"  principle, 
the  second  type  of  correlation  pattern  is  believed  to  reflect 
modes  of  caregiver  behavior,    Por  example,  certain  caregivers 
may  tend  to  deal  with  children  on  a  smaller  scale  and  thus 
will  spend  more  time  with  individual  children  and  small  groups 
and  less  time  with  medium  and  large  groups.     In  this  case,  the 
caregiver  chooses  to  spend  time  in  this  type  of  behavior 
configuration.     On  the  basis  of  the  correlation  among  these 
codes  alone,   it  .s  difficult  to  distinguish  between  these  two 
patterns;   in  conjunction  with  measures  of  classroom  structure — 
group  size,  staff  count  and  staff/child  ratio — however,  the 
picture  becomes  clearer. 

The  variable  TO  STAFP  reflects  the  amount  of  time 
caregivers  spend  with  each  other  as  opposed  to  with  children. 


Table  3,2  displays  the  correlation  matrix  of  the 
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Its  correlation  pattern  with  the  other  TO  WHOM  codes  Is 
not  clearly  defined;  although  it  is  negatively  correlated 
with  both  medium  and  large  groups.  It  appears  to  be  Indepen- 
dent of  TO  CHILD  and  TO  SMALL  GROUP.     Examination  o^  the 
classroom  structure  variables  (CHILD  COUNT,  STAFF  COUNT) 
shows  that  TO  STAFF  appears  to  be  a  function  of  classroom 
resources;  classes  in  which  more  staff  are  present  and/or 
the  staff/child  ratio  is  higher,  tend  to  have  caregivers 
spending  more  time  with  each  other.*    That  is,  as  more  staff 
work  In  th«  classroom,  more  of  an  individual  caregiver's 
time  is  spent  with  other  staff  members. 

The  variable  TO  CHILD  appears  to  be  relatively 
Independent  of  all  measure.,  of  classroom  structure.     That  is 
the  amount  of  time  a  given  caregiver  spends  in  one-to-one 
interactions  with  individual  children  is  fairly  independent 
of  the  number  of  children  present,  the  number  of  staff  pre- 
sent or  the  resulting  ratio.     From  the  child's  perspective, 
however,  it  is  possible  that  the  amount  of  one-to-one 
interaction  an  individual  child  receives  is  a  function  of 
these  measures;  more  caregivers  may  imply  more  total  one-to- 
one  interaction  time.     Table  3.2  also  indicates  that  care- 
givers who  spend  more  time  in  one-to-one  Interaction  also 
tend  to  spend  more  time  in  small  groups  (and  less  time  in 
large  groups).     However,  these  correlations  are  not  strong- 
coupled  with  the  Independence  of  this  variable  from  the 
classroom  structure  measures,  this  suggests  that  it  is  wise 
to  retain  TO  CHILD  as  a  separate  measure. 

The  variable  TO  SMALL  GROUP  seems  to  be  particularly 
associated  with  classroom  staff/child  ratio.     Moreover,  it  is 

*orc}assroSm'^^''  !?"  that  the  AFI  measurements 

klSd  fr.™  «K    ""^"5^  (esp>?cially  staff  count)  are  different 
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negatively  correlated  with  both  TO  MEDIUM  GROUP  ard  TO  LARGE 
GROUP.    Since  it  is  a  ratio  measurement,  however,  and  TO 
MEDIUM  GROUP  and  TO  LARGE  GROUP  appear  to  be  more  properly 
considered  child  count  (or  staff  count)  measures,  it,  too, 
was  retained  as  a  separate  V2^riable« 

The  data  suggest  that  it  would  be  wiser  to  combine 
TO  MEDIUM  GROUP  and  TO  LARGE  GROUP  into  a  single  variable,  how 
ever.    The  codes  are  strongly  negatively  correlated  (r  =  -.42) 
thus  indicating  that  caregivers  who  spend  more  time  in  medium- 
sized  groups  tend  to  spend  less  time  in  large  groups.  While 
this  could  be  an  artifact  of  the  "limited  resources"  principle 
examination  of  the  correlations  of  these  two  codes  with  the 
classroom  structure  variables  suggests  that  this  behavior 
may  be  more  properly  considered  as  due  to  the  dynamic 
structure  of  the  classroom.     That  is,  whether  a  caregiver 
deals  with  a  medium-sized  group  as  opposed  to  a  large  group 
is  affected  by  the  child  count,  staff  count  and,  to  a  lesser 
degree,  the  resulting  staff /child  ratio.    As  the  overall 
classroom  group  size  increases,  caregivers  tend  to  spend 
less  time  with  medium  groups  and  more  time  with  large 
groups;   indicating  that  the  scale  of  the  classroom  (as 
measured  by  child  count)  determines  the  scale  of  the  groups 
that  the  caregiver  focuses  attention  upon.  Subtracting 
these  two  measurements,  then,  creates  a  variable  relating  to 
the  scale  of  the  groups  actually  found  in  the  classroom. 
Toward  this  end,  a  new  variable  GROUP  SCALE  was  defined  as: 

GROUP  SCALE  =  TO  LARGE  GROUP  -  TO  MEDIUM  GROUP. 

This  variable  can  be  thought  of  as  representing  a  continuum; 
on  one  end  of  the  continuum  are  classes  in  which  the  caregiver 
spends. a  sizable  portion  of  time  in  medium  groups  and  little 
or  no  time  in  large  groups,  and  on  the  opposite  end  are 
classes  which  are  predominantly  organized  into  large  groups 
of  children  and  rarely  into  medium-sized  groups.  The 
variable  GROUP  SCALE  indicates  where  an  individual  class 
falls  along  this  continuum.     As  Table  3.2   Indicates,  it 
contains  most  of  the  information  reflected  in  the  individual 


346 


codes;  moreover,  GROUP  SCALE  is  quite  highly  correlated  with 
all  measures  of  child  count,  suggesting  that  it  is  indeed 
reasonable  to  consider  it  a  dynamic  measure  of  group  size. 

Attention  now  shifts  from  the  TO  WHOM  codes  to 
the  WHAT  codes;  once  again,  the  aim  is  to  describe  care- 
giver behavior  patterns  with  as  few  variables  as  necessary. 
Table  3.3  contains  a  correlation  matrix  of  the  API  codes, 
grouped  according  to  their  correlation  pattern.     On  the 
basis  of  this  matrix,  three  API  macro-codas  were  construc- 
ted—one for  each  of  the  first  three  blocks  of  variables. 
Prom  the  first  block,  as  previously  discussed,  the  varia- 
ble GROUP  SCALE  was  constructed.     The  next  two  codes  that 
appear  in  the  table  are  COMMANDS  and  CORRECTS;  both  codes 
reflect  management  behavior  by  caregivers.     Due  to  the  high 
correlation  between  these  two  codes  (r  =  .45)  and  their 
similarity  in  content,  a  MANAGEMEUT  macro-code  was  defined 
as: 

MANAGEMENT  =  COMMANDS  +  CORRECTS 
Although  these  variables  are  also  correlated  with  several  of 
the  other  behavior  codes,  the  pattern  thau  emerged  suggested 
that  it  would  be  wise  to  treat  these  two  separately  from  the 
remaining  codes;  moreover,  the  remaining  codes  do  not  seem 
to  be  related  in  content  to  these  two  codes. 

The  next  five  variables  displayed  in  Table  3.3  also 
form  a  cluster:     DIRECT  QUESTIONS,  RESPONDS,  COMPORTS, 
PRAISES  and  OBSERVES.     All  of  these  codes  pertain  to  the 
social  interactiveness  of  caregivers;  the  first  four  are 
aspects  of  an  interactive' caregiver,  while  OBSERVES  relates 
to  the  noninteractive  caregiver.     The  correlation  pattern 
among  these  codes  reflects  the  meaning  one  may  ascribe  to 
each  of  them;  the  first  four  are  all  positively  correlated 
with  each  other  (with  r's  ranging  from  .10  to  .57),  while 
OBSERVES  is  negatively  correlated  with  each  of  them.     On  the 
basis  of  these  correlations  the  macro-code  SOCIAL  ACTIVITY 
was  defined  as: 
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Table  3.3 

Adult-Focus  Instruiient  Correlations 
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N.B.  Only  those  correlatioas  significant  at  the     .15  level  or  better  are  presented. 
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SOCIAL  ACTIVITY  =  DIRECT  QUESTIONS  +  RESPONDS  + 
COMFORTS  +  PRAISES  -  OBSERVES. 

This  variable  may  be  regarded  as  the  excess  of  tine  spent 
socially  interacting  with  children  as  opposed  to  passively 
observing  them.*    The  variable  INSTRUCTS  was  excluded  from 
this  construct  because  it  was  negatively  correlate.^1  with  oi 
of  the  component  codes,  COMFORTS. 


The  remaining  AFI  code,  ADULT  ACTIVITY,  does  not 
appear  to  fit  into  a  discernable  pattern,  and  hence  will  be 
treated  separately.     Although  it  is  negatively  correlated 
with  MANAGEMENT  and  its  component  codes,  the  variable  does 
not  refer  to  caregiver  behavior  towards  children,  and  hence 
the  codes  were  not  combined. 


Just  as  the  CFI  appears  to  be  an  internally  con- 
sistent measure  of  child  behavior,  the  AFI  also  seems  to 
provide  a  fairly  clear  and  consistent  profile  of  adult  behavior. 
Note  that  in  Table  3.3,  the  variable  TO  CHILD  is  quit«  strongly 
related  to  both  MANAGEMENT  and  SOCIAL  ACTIVITY;  interactive 
caregivers  tend  to  focus  their  attention  -.o  individual  children 
more  often  than  do  noninteractive ,  passive  caregivers.  Moreover, 
the  strength  of  the  simple  correlations  among  the  behavior 
codes  suggests  that  caregivers  who  are  interactive  display 
their  behavior  in  a  va-iety  of  w^ys  which  fit  together  into 
a  pattern.     That  is,  caregivers  who  display  one  of  the  inter- 
active behaviors  also  tend  not  to  spend  a  large  proportion 
of  their  time  nassively  observing}  children.  Interactive 
caregivers  also  tend  to  instruct  more  often,  although  this 
pattern  is  not  as  clearly  defined  as  that  for  the  other 
codes.     Finally,  Table  3.3  shows  that  caregivers  who  spend  a 


AFI  main  effects  analyses  used  two  alternative  formulations 
of  the  social  interactiveness  code.     For  a  description  of 
the  construction  of  these  codes  see  Goodson,  1980.  Note, 
however,  that  the  correlations  among  these  three  constructs 
IS  quite  high   (r's  from  .7  to  .9)   and  thus  they  may  all  be 
thought  of  interchangeably. 


large  proportion  of  their  time  In  adult-related  activity 
spend  less  of  their  time  Interacting  with  children  (especially 
on  an  Individual  basis)  and,  as  expected,  more  time  directing 
their  attention  towards  other  adults. 

Summary 

Both  the  Child-  and  Adult-Focus  Instruments  were 
analyzed  individually  and  were  found  to  have  a  great  deal  of 
internal  structure.     In  an  effort  to  remove  redundant  Informa- 
tion from  each  of  the  Instruments,  several  macro-codes  were 
constructed  which  condensed  the  Informatlo:     '^ritalned  In 
each  of  these  sources. 

From  the  CFI,  It  appears  that  classe:5  .:c^r^  be  clas- 
sified into  several  distinct  categories  across  r.   '        ty  of 
dimensions.     One  dimension  which  classes  may  b*      :  t-.li';gulshed 
by  is  the  degree  to  which  children  are  actively  j-ivclved  In 
classroom  activities.     Several  codes  describe  this  dimension: 
CONSIDERS,  ADDS  PROP,  WANDERS  and  NON-INVOi.VSMENT.     A  second 
dimension  refers  to  the  degree  to  which  classes  are  structured 
by  a  grert  deal  of  adult  involvement;  codes  such  as  RECEIVES, 
ATTENTION  TO  ADULT  and  ACTIVITY  TYPE  all  reflect  this 
dimension.     The  variable  COOr-ERATES  seems  to  represent  a 
third  distinct  dimension,  although  it  too  is  correlated  v;lchx  - 
the  degree  of  classroom  structure. 

The  AFI  also  produced  a  series  of  dimensions  by 
which  to  classify  classes      ?he  fiL'ist  dimension  is  interactive- 
ness; this  is  represente-^  ■.>y  the  code  TO  CHILD  and  the  two 
macro-codes  SOCIAL  ACTIVITY         MAKi^GEMENT.     The  macro-codes 
appear  to  measure  two  re}c?clvely  distinct  dimensions  oi 
interactiveness;  however,  they  are  both  highly  correlated 
with  the  TO  CHILD  code.     The  second  major  dimension  derived 
from  the  AFI  was  GROUP  SCALE  which  reflects  the  size  of  the 
groups  into  which  adults  ter.d  to  structure  the  classroom. 
A  third  dimension  Is  the  degree  to  which  the  caregiver 
spends  time  instructing. 
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CHAPTER  FOUR:     CROSS-INSTRUMENT  EXPLORATION; 


AFI-CFI  LINKAGES 


With  the  internal  structure  of  each  instrument 
more  clearly  defined,  it  is  now  possible  to  explore  the 
relationships  between  adult  behavior  and  child  behavior. 
Some  caveats  are  in  order.     First,  it  i^  important  to  note 
that  although  both  instruments  record  descriptions  of  day 
care  process,  the  profiles  they  provide  are  from  two  dif- 
ferent perspectives,  and  derive  from  different  days  of 
observation.     The  AFI  by  its  very  nature  records  the  overall 
process  and  structure  of  the  day  care  classroom.     By  concen- 
trating upon  a  focal  caregiver,  who  must  in  tu-n  interact 
with  the  entire  class,  the  instrument  picks  up  information 
concerning  the  manner  in  which  the  caregiver  shapes,  mani- 
pulates and  structures  her  class.     On  the  other  hand,  the 
CFI  pays  direct  attention  to  what  an  individaal  child  is 
doing  during  a  twenty-minute  period;  even  aggregated  to  the 
classroom  level,  the  information  it  provides  does  no<: 
relate  specifically  to  the  process  of  day  care.     For  th.: 
most  part,  it  describes  specific  activities  or  behaviors, 
such  as  cooperation,  giving  opinions  or  wandering,  as 
opposed  to  describing  the  overall  tone  of  the  class. 
Moreover,  there  is  no  one-to-one  relationship  between  many 
of  the  child  behavior  codes  and  adult  behavior  codes;  in 
fact,  almost  all  the  AFI  WHAT  codes  map  into  tne  single 
CFI  RECEIVES  INPUT  code.     Adding  to  these  ccmments  the  fact 
that  observers  for  the  AFI  and  CFI  were  present  on  dif:" -rent 
days  implies  that  many  relationships  between  AFI  and  CFI 
codes  may  be  weak,     in  fact,  the  strongest  linkages  shoulr" 
be  through  the  AFI  TO  WHOM  codes  and  the  "structural"  oi 
"process"  measures  from  the  CFI:     the  attention  cod-s  and 
the  macro-code  CLASS  STRUCTURE.     These  codes  describe 
similar  classroom  features  across  the  instruments,  an.1  tl  air 
relationships  may  be  strong.     Such  findings  would  be  helpful 
in  serving  to  cross-validate  the  instruments. 


Correlation  Results 


Table  4,1  presents  the  correlations  between  the 
API  and  CFI  variables  at  the  classroom  level;  as  befor^^,  an 
attempt  has  been  made  to  group  variables  according  to  their 
correlation  pattern.     A  description  of  the  linkages  found 
will  be  presented  by  AFI  groups,  and  will  concentrate  on 
those  correlations  significant  at  the  .05  level  or  better. 

Focus  of  Caregiver's  Attention 

How  a  caregiver  distributes  attention,  as  opposed 
to  what  she  does,  appears  to  be  relatively  strongly  associated 
with  child  behavior.     That  is,  how  much  time  a  caregiver 
spends  with  each  of  the  various  "objects"  available,  and  how 
she  structures  the  classroom  (into  small,  medium  or  large 
groups)   is  of ten  related  to  the  types  of  behavior  children 
display  and  the  focus  of  their  attention. 

Classes  in  which  caregivers  spend  a  large  propor- 
tion of  their  time  dealing  with  other  caregivers  (frequency 
of  TO  STAFF  is  high)   tend  to  be  those  in  which  children  are 
more  frequently  found  wandering  and  inattentive  toward 
groups  of  people.     These  classes  are  more  often  organized 
into  open-ended  activities  than  into  structured  ones; 
moreover,  the  children  tend  not  to  receive  input  from  adults 
as  frequently.     Thus,  classes  in  which  the  lead  teacher 
spends  a  great  deal  of  time  interacting  with  other  adults 
seem  to  be  loosely  structured  for  the  children,  and  many 
children  do  not  appear  to  be  involved  in  activities.     On  the 
other  hand,  TO  STAFF  is  correlated  positively  with  TASK 
PERSISTENCE  implying,  perhaps,  that  those  children  who  are 
involved  in  a  task  are  not  interrupted,  but  rather  can 
pursue  tasks  for  longer  periods  of  time. 

One-to-one  interaction  with  children  (TO  CHILD) 
appears  to  have  little  relationship  with  child  behavior. 
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Table  4.1 

AFKFI  Cross-Instrunent  Correlations 
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H.B.  Only  those  correlations  significant  at  thec^»  .15  level  or  better  are  prpsented. 
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The  only  correlation  significant  at  the  .05  level  was 
that  of  TO  CHILD  with  CLASS  STRUCTURE.     Adult  interaction 
with  individual  children  occurs  more  often  in  classes  with  a 
concentration  of  open-ended,  expressive  activities.  One 
interpretation  of  this  result  is  that  one-to-one  interaction 
occurs  in  all  classrooms  to  the  same  degree;  that  is,  all 
teachers  must,  at  times,  stop  other  activities  and  pay 
attention  to  individual  children  who  are  crying,  wandering, 
or  teasing  other  children.     It  could  be  that  this  factor  is 
stable  across  classrooms  of  different  types  and  varying 
teacher  styles. 

The  amount  of  time  caregivers  spend  focusing  their 
attention  TO  SMALL  GROUPS  is  significantly  associated  with 
two  child  behavior  measurements.     Classes  organized  into 
small  groups  tended  to  be  characterized  by  children  attending 
more  to  the  environment  and  less  to  adults.     This  might  seem 
anomalous  since  a  child  in  a  small  group  directed  by  the 
teacher  should  be  attending  less  to  the  environment  and  more 
to  adults.     The  explanation  is  probably  that  the  CFI  and  AFI 
were  done  on  different  days  so  that  there  is  no  reason  to 
believe  that  the  child  under  observation  is  a  member  of  the 
small  group  to  whom  the  caregiver  is  paying  attention.  In 
fact,  the  class  in  which  the  child  is  observed  may  have  no 
small  groups,  and  even  if  the  class  is  organized  into 
small  groups  during  the  CFI  observation,  the  child  being 
followed  may  be  in  another  group  or  playing  alone. 

Caregivers  who  focus  their  attention  to  medium- 
sized  groups  tend  to  have  children  who  are  involved  in  more 
structured  types  of  child  activities.     Children  in  these 
classes  pay  more  attention  to  an  adult  and  less  to  the 
environment,  and  they  receive  more  input  from  adults.  In 
opposition  to  these  findings,  caregivers  who  focus  their 
attention  to  large-sized  groups  tend  to  have  more  children 
wandering  and  fewer  involved  in  thoughtful  activities.  The 
balance  between  these  two  activities,  as  exemplified  by  the 


code  INOIPFERENCE  is  clearly  in  the  direction  of  wanderinq 
(r  =  .31).     Whereas  children  in  classrooms  frequently 
orqanized  into  medium-sized  oroups  seemed  to  be  attendinq  to 
adult-directed  tasks,  children  in  larqe  qrouDS  (usually  the 
whole  class)  were  often  uninvolved  in  activities  and  wandering 
aimlessly  about  the  classroom. 

In  sum,  the  API  attention  codes  TO  STAFF,  TO 
MEDIUM  GROUP,  TO  LARGE  GROUP,  and  GROUP  SCALE  show  clear 
patterns  of  relationships  with  child  behaviors.     Classes  in 
which  caregivers  pay  more  attention  to  other  staff  or  to 
larqe  qroups  have  more  uninvolved  children  and  the  children 
receive  less  input  from  careqivers  about' their  activities, 
conversely,  classes  in  which  caregivers  pay  more  attention 
to  medium-sized  groups  of  8  to  12  children—effectively  a 
subgroup  of  the  class— have  children  who  are  involved  in 
structured  activities,  receiving  inout  from  adults  to  whom 
thev  are  paying  attention. 

Management  Behavior 

Classes  in  which  caregivers  soend  more  time  in 
management  behaviors  (commanding  and  correcting)  tend  to  be 
those  in  which  the  balance  between  wandering  and  active 
involvement  of  children  is  in  favor  of  wandering.  The 
children  are  infrequently  engaged  in  reflective  behaviors 
and  are  not  paying  much  attention  to  other  children.  This 
seemina  lack  of  child  attention  to  tasks  in  highly  "managed" 
classrooms  does  not  mean  that  management  behavior  causes 
wandering  or  lack  of  thought;   in  fact,  this  is  a  prime 
examole  of  a  situation  in  which  child  behavior  may  influence 
adult  behavior.     That  is,  because  the  children  are  not 
involved  in  classroom  activities,   it  may  be  necessary  for 
careqivers  to  command  and  correct  them  more  often  to  main- 
tain order  in  the  classroom.     Alternatively,   if  adults  spend 
so  much  timP  managina  the  class,  they  nav  not  have  (or  make) 
time  to  encourage  chilH  involvement.     Hence,   it  is  important 
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to  realize  that  these  correlations  merely  represent  associ- 
ations; it  is  not  possible  to  infer  a  causal  link  between 
adult  and  child  behavior.     Note,  for  example,  that  no 
association  was  found  between  the  deoree  of  class  structure 
and  manaqement  behavior;  commandinQ  and  correcting  occur  as 
frequently  in  open-ended,  expressive  activities  as  in 
closed,  structured  activities. 


active  behavior  are  not  clearly  defined;  only  a  few  of 
the  component  codes  are  related  to  child  behavior,  and  no 
CFI  codes  are  significantly  related  to  the  macro-code  SOCIAL 
ACTIVITY.     In  general,  classes  in  which  caregivers  displayed 
social  behavior  as  opposed  to  passive  observational  behavior 
tended  to  be  characterized  by  more  frequent  verbal  initiatives 
on  the  part  of  children,  more  receipt  of  input  from  adults, 
less  wandering,  more  moving  with  purpose,  and  less  time 
spent  not  actively  involved  in  a  task.     Moreover,  these 
classes  tended  to  spend  more  time  in  open,  unstructured 
activities  than  in  closed,  structured  ones.     But  none  of 
these  relationships  are  significant  at  the  .05  level,  so 
they  must  be  viewed  cautiously.     That  is,  it  is  important 
not  to  place  much  faith  in  them  as  stand-alon<5  results,  but 
rather  to  view  them  in  the  context  of  other  study  results* 


behavior  and  child  measures  represent  basic  validations  of 
each  of  the  instruments  though  the  size  of  the  correlations 
is  small.     Classes  in  which  caregivers  spend  more  time 
instructing  are  those  in  which  children  tend  to  receive 
input  from  adults  more  often;  moreover,  children  tend  to 
focus  their  attention  towards  adults  or  groups  in  these 
classes  as  opposed  to  the  environment.     As  expected^  these 


Social  Activity 


The  results  for  the  components  of  socially  inter- 


Instruction  and  Adult  Activity 


The  correlations  found  between  these  tvpes  of  adult 
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classes  also  seem  to  be  conducted  in  more  structured  routines 
than  in  open-ended,  expressive  ones.     No  relationships  were 
found  between  the  amount  of  instruction  and  child  behaviors 
such  as  VERBAL  INITIATIVE  and  REFLECTION/INNOVATION. 

None  of  the  correlations  between  ADULT  ACTIVITY 
and  child  behaviors  were  statistically  significant,  m 
this  case,  the  trends  do  not  fit  well  into  a  composite 
picture  of  day  care  and,  as  such,  must  be  viewed  with 
caution. 

Additional  Analyses 

Two  supplementary  sets  of  analyses  were  carried 
out  on  these  data:     an  examination  of  scatterplots  to  search 
for  outliers;  and  a  variance  components  analysis  to  determine 
the  sources  of  variation  in  the  findings.     To  ensure  that 
the  findings  were  not  attributable  to  outliers,  an  exten- 
sive examination  of  scatterplots  was  conducted.  Classes 
which  appeared  to  be  atypical  (either  because  of  range  or 
inability  to  fit  into  the  overall  pattern)  were  set  aside 
from  analysis  and  correlation  matrices  were  re-estimated. 
The  relationships  (or  lack  thereof)  found  in  these  new 
correlations  did  not  greatly  differ  from  those  in  the 
original  matrices,  and  hence  the  results  described  above 
appear  to  be  rather  stable. 

Second,  variance  components  analyses  were  done  on 
the  API  and  CFI  variables.     Results  indicated  that  both  the 
measures  have  low  reliabilities.    That  is,  the  amount  of 
systematic  variation  in  the  data  attributable  to  various 
sources  is  small  relative  to  the  total  variation.  This 
means  that  there  is  a  great  deal  of  "noise-  or  randon  error 
present  in  these  data..  As  the  amount  of  noise  in  the  data 
increases,  the  ability  to  detect  effects  decreases.  Corre- 
lations attempt  to  li„|.  the  systenacic  variation  present  in 
two  variables;  when  both  variables  have  low  reliabilities 
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(as  in  this  situation),  the  ability  to  make  these  linkages 
is  severely  diminished.    Thus  it  is  not  surprising  that  so 
few  significant  correlations  were  fourfd  and  that  those  that 
were  found  were  not  overwhelmingly  strong* 

In  sum,  the  correlation  results  appear  to  be 
fairly  stable  across  classes  but  to  contain  a  great  deal  of 
noise.     Relationships  which  were  statistically  significant 
were  relatively  rare,  but  did  occur  in  such  expected  areas 
as  the  API  TO  WHOM  codes  and  the  CFI  attention  codes.  The 
findings  thus  provide  a  cross-validation  of  the  two  instru- 
ments but  cannot  give  much  information  on  more  specific 
relationships  of  teacher  and  child  behaviors. 
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level  variability  of  the  observation  data  in  a  center-level 
analysis,  this  loss  of  information  seems  minor  compared 
to  that  encountered  if  two  hundred  children's  test  scores 
were  to  be  omitted  from  analysis.     Thus,  the  center-level 
aggregated  CFI  and  AFI  data  nay  be  thought  of  as  reflecting 
average  classroom  activity  patterns  and  styles  within  a 
given  center. 


essentially  parallel  those  used  in  the  cognitive  main 
effects  analysis.     Initially,  two-way  plots  of  PSI  GAINS  and 
PPVT  GAINS  versus  each  of  the  available  regressors  were 
examined.     On  the  basis  of  these  graphs,  several  centers 
were  determined  to  be  potential  outliers.    Weighted  correla- 
tions were  then  computed  with  and  without  the  potential 
outliers.     Using  these  matrices  as  a  guideline,  regression 
models  were  constructed  to  predict  cognitive  gain  scores.* 


the  examination  of  adult  behavior,  child  behavior,  major 
policy  variables  and  cognitive  test  scores  is  discussed, 
and  then  additional  center  characteristics  (e.g.,  CDA 
ratings,  director  qualifications)  are  added  to  the  picture. 

Linkage  of  Observations  and  Cognitive  Test  Data 


The  first  stage  in  the  analysis  of  the  rela- 
tionships between  generalized  gain  scores  and  child  and 
adult  behavior  was  to  examine  scatterplots  of  PSI  GAINS  and 
PPVT  GAINS  versus  each  of  the  CFI  and  AFI  variables  (as 
obtained  from  the  class-level  analysis).     These  graphs 


*To  insure  that  results  obtained  would  not  be  affected  by 
such  variables  as  socioeconomic  status  and  race,  covariables 
were  included  in  various  stages  of  analysis. 


The  steps  employed  in  the  process-outcome  linkage 


Analysis  is  described  in  two  stages:  first. 


Examination  of  Scatterplots 
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suggested  that  CFI  data  bore  a  strong  relationship  to  PSI 
gain  scores,  while  AFI  data  was  associated  with  ppvt  gain 
scores.     From  the  outset  it  is  important  to  note  that 
although  single  time  point  test  scores  on  the  PSi  and  the 
PPVT  are  highly  correlated,  the  generalized  gain  scores  used 
in  all  NDCS  analyses  are  relatively  independent.     (At  the 
center  level,  the  correlation  between  the  cognitive  gain 
scores  used  in  the  process-outcome  analysis  is  0.39.)     As  a 
result,  variables  that  are  significantly  correlated  with  one 
of  the  measures  do  not  necessarily  have  to  be  correlated 
with  the  other  measure.    Although  it  may  be  desirable  to 
find  that  the  same  variables  predict  both  gain  scores,  the 
philosophy  in  this  analysis  has  been  to  treat  each  dependent 
variable  separately,  and  then  to  borrow  strength  across  the 
• "sts  when  interpreting  results. 

In  addition  to  suggesting  that  the  two  tests  may 
be  associated  with  different  types  of  data,  these  graphs 
also  showed  that  there  were  several  centers  which  did 
not  fit  into  the  overall  pattern  for  many  of  the  dependent 
and  independent  variables.     Three  of  these  centers  were  the 
same  ones  set  aside  from  the  cognitive  main  effects  analysis. 
For  the  PSI,  one  additional  center  appeared  to  be  rather 
atypical;  tor  the  ppvt  there  were  two  other  centers  which 
might  be  considered  outliers.     To  insure  that  future  results 
would  not  be  unduly  influenced  by  these  centers  (four  for 
the  PSI  and  five  for  the  ppvT)   they  were  both  included  and 
excluded  from  the  next  stage  of  analysis  (correlations),  to 
determine  their  effect  (if  any)   upon  results. 

Correlations  of  Observations  and  Gain  Scores 

For  each  generalized  gain  score,  weighted  cor- 
relation matrices  were  constructed  both  with  and  without 
these  outlier  centers,  where  the  weights  were  proportional 
to  the  number  of  children  whose  scores  were  used  to  compute 
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the  center-level  gain  scores.     There  are  two  primary  reasons 
for  weighting  cases  by  the  appropriate  number  of  children. 
First,  since  the  center-level  aggregations  were  computed 
with  varying  numbers  of  children,  the  information  contained 
in  each  case  had  a  varying  level  of  accuracy  or  stability. 
Second,  weighting  alleviates  problems  created  by  undue 
influence  of  small  centers  with  few  children,  whereas  equal 
weighting  tends  to  disproportionately  "favor"  those  centers. 

As  expected,  these  correlation  matrices  indicated 
that  the  outlier  centers  were  unduly  influencing  results. 
For  example,  the  correlation  between  PSI  GAINS  and  COOPERATES 
is  0,19  if  all  centers  are  included  in  analysis;  when  the 
four  atypical  centers  are  omitted,  the  correlation  jumps  to 
0,42,     These  four  centers  fell  so  far  away  from  the  general 
pattern  that  they  made  an  effect  that  is  actually  quite 
dramatic  appear  to  be  just  barely  significant.  Therefore, 
the  outlier  centers  were  set  aside  from  subsequent  analyses, 
and  only  the  results  for  the  remaining  centers  will  be 
discussed , * 

Tables  5,1  and  5,2  display  the  weighted  correla- 
tion matrices  estimated  for  PSI  GAIN  and  PPVT  GAIN,  respec= 
tively.     Correlations  are  presented  only  for  those  variables 
which  were  significantly  correlated  with  the  gain  scores  at 
the  ,15  level  or  better;  only  those  correlations  significant 
at  the  ,05  level  or  better  will  be  discussed.     In  general, 
the  correlations  confirm  the  previously  mentioned  indication 
that  the  PSI  is  more  highly  associated  with  CFI  data  and  the 
PPVT  with  AFI  data. 

Several  aspects  of  day  care  classes  as  described 
by  the  CFI  seem  to  be  associated  with  higher  generalized 


*These  centers  were  included  in  several  biweighted  analyses, 
and  were  found  to  receive  very  low  weights,  thus  reinforc- 
ing the  notion  that  they  were  distorting  the  overall 
correlational  pattern. 
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Table  5.1 
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N.B.  Only  those  correlation  significant  at  the  ^=  .15  level  or  better  are  presented, 
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N.B.  Only  those  correlations  significant  at  the  V=  .15  level  or  better  are  presented. 
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gain  scores  on  the  PSI.     Children  in  these  centers  are  more 
frequently  observed  actively  integrated  into  classroon 
activities  as  opposed  to  wandering  aimlessly;  they  engage  in 
more  reflective  and  innovative  behavior,  cooperate  more,  and 
receive  more  input  from  adults. 

Caregiver  behavior  as  measured  by  the  AFI  does  not 
appear  to  bear  a  great  deal  of  relationship  to  PSI  gains,  as 
the  only  correlation  to  reach  even  the  .15  level  is  that  of 
PSI  GAINS  and  GROUP  SCALE.     There  is  thus  a  suggestion  that 
caregivers  who  focus  their  attention  more  often  to  medium- 
sized  groups  as  opposed  to  large  ones  tend  to  be  found  in 
those  centers  where  cognitive  gains  are  higher.     This  result 
has  greater  importance  when  judged  in  conjunction  with 
GROUP  SIZE.     In  particular,  GROUP  SIZE  is^ significantly 
correlated  with  both  GROUP  SCALE  and  PSI  G^INS.     The  smaller 
the  assigned  group  size,  the  higher  the  PSI  GAINS  and  the 
more  likely  a  caregiver  is  to  focus  her  attention  on  nedium- 
rather  than  large-sized  groups,     when  the  assigned  group 
size  is  large,  PSI  GAINS  are  smaller  and  it  seems  caregivers 
structure  the  classes  into  larger  groups   (at  least,  they 
spend  more  time  paying  attention  to  large  groups).  GROUP 
SCALE  could  thus  be  considered  an  index  of  effective  size  of 
the  groups  in  the  classroom,  and  its  relationship  with  PSI 
GAINS  of  theoretical,  if  not  statistical,  significance. 

Unfortunately,  there  are  two  major  anomalies  in 
the  relationship  of  the  observational  data  and  PSI  GAINS: 
the  strong,  negative  correlation  between  TASK  PERSISTENCE  and 
PSI  GAINS   (r  =  -0.32),  and  the  strong  positive  correlation 
between  NON-INVOLVEMENT  and  PSI  GAINS    (r  =  0.31).  Although 
disturbing,  these  results  can  be  explained,  at  least  in 
part,  by  the  fact  that  the  meaning  of  each  of  these  codes 
nay  be  expected  to  vary  with  the  activity  type   (free  play  or 
teacher-directed  activity)   in  which  the  observation  is  made; 
when  aggregated  across  all  activities  as  was  done  here,  the 
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interpretation  of  the  codes  becomes  problematic.  TASK 
PERSISTENCE  is  expected  to  occur  more  in  structured  situ- 
ations; NON-INVOLVEMENT  more  in  free  play.    When  these  codes 
(but  not  most  of  the  other  codes)  are  aggregated  across 
structured  and  free  play  situations,  one  must  expect  anom- 
alous findings  and  it  is  important  not  to  allow  them  undue 
significance. 

While  the  PSI  appears  to  be  primarily  associated 
with  CFI  data,  the  PPVT  seems  to  be  more  strongly  related  to 
AFI  measurements  of  classroom  process.     Caregivers  who  spend 
more  of  their  time  in  medium-sized  groups  as  opposed  to 
large  groups  tend  to  be  found  in  centers  where  children 
achieve  higher  generalized  PPVT  gains.     As  previously  noted, 
this  result  refines  our  understanding  of  the  meaning  of  the 
variable  GROUP  SIZE,     in  the  case  of  the  PPVT,  moreover, 
this  relationship  is  even  more  important.     Recall  that  in 
the  cognitive  main  effects  analysis,  the  primary  foundation 
for  stating  the  importance  of  GROUP  SIZE  was  results  obtained 
for  the  PSI.     Although  similar  patterns  were  found  for  the 
PPVT,  the  strength  of  the  group  size  finding   (based  upon  the 
observational  measurement  GROUP  SIZE),  was  weaker.  The 
findings  for  the  variable  GROUP  SCALE,  however,  provide 
a  strong  basis  for  declaring  the  significance  of  group  size 
for  the  PPVT  as  well. 

The  amount  of  one-to-one  interaction  between 
children  and  adults   (TO  CHILD)   is  also  strongly  related  to 
generalized  gains  on  the  PPVT.     Not  only  is  the  quantity  of 
this  individual  interaction  important,  but  also  the  degree 
of  socially  interactive  behavior.     The  correlation  between 
SOCIAL  ACTIVITY  and  PPVT  GAINS  is  the  strongest  of  any 
correlation  between  an  independent  variable  and  either  of 
the  measures  of  cognitive  gain  (r  =  0.46).     Centers  in  which 
careqivers  organize  medium-sized  groups,  pay  attention  to 
individual  children,  and  interact  socially  with  their 
children  are  those  centers  with  higher  PPVT  GAINS. 
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Certain  child  behaviors  were  also  found  to  be 
significantly  correlated  with  ppvt  GAINS.    As  with  the 
PSI,  classes  in  which  children  are  mere  actively  involved  in 
classroom  activities  instead  of  wandering  around  aimlessly 
tend  to  be  those  in  which  children  have  higher  gains.  m 
addition,  children  who  "move  with  purpose-  are  more  often 
found  in  these  higher  gain  centers,     it  is  interesting  to 
note  that  such  variables  as  RECEIVES  INPUT,  COOPERATES,  and 
REFLECTION/INNOVATION,  which  were  quite  strongly  associated 
with  PSI  GAINS,  were  not  related  to  PPVT  GAINS.     The  measures 
of  movement  about  the  room  or  involvement  in  tasks  were 
associated  with  the  more  verbal  measure  of  child  gains  while 
a  more  diverse  set  of  child  behaviors  were  related  tc  PSI 
GAINS. 

Development  of  Regression  Models 

The  correlation  patterns  outlined  above  describe 
the  associations  between  child  and  adult  behavior  and 
cognitive  gains  on  an  individual  basis,     with  these  rela- 
tionships in  mind,  it  is  now  possible  to  model  the  combined 
associations  of  these  variables  through  multiple  regression 
analysis. 

A  parsimonious  approach  to  model  construction  was 
taken  for  this  analysis  in  order  to  pay  careful  attention  to 
problems  of  nulticollinearity  of  independent  variables 
Thi?  approach  has  several  advantages.    Most  important,  when 
the  independent  variables  are  not  truly  independent  (i.e., 
when  they  are  multicollinear) ,  a  less  parsimonious  approach 
may  yield  results  that  are  uninterpretable,  whereas  a  more 
exploratory  approach  often  leads  to  a  series  of  regression 
equations  which  in  combination  indicate  the  relationships 
between  independent  and  dependent  variables.     Second,  at  the 
center  level,  there  are  just  slightly  more  than  fifty  cases; 
yet  there  are  almost  forty  independent  variables  of  interest 
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with  these  dimensions,  it  would  be  next  to  impossible  to 
reasonably  analyze  the  relationships  between  independent  and 
dependent  variables  using  all  independent  variables  simultan- 
eously.    Note,  however,  that  these  dimensions  also  imply 
that  there  are  problems  of  mul tipl icity_in  any  approach  to 
analysis.     Our  ability  to  "borrow  strength"  across  a  wide 
variety  of  dependent  variables  (in  the  different  main 

3 

effects  analyses) ,  helps  to  protect  us  from  this  threat. 

On  the  basis  of  correlations  in  Tables  5.1  and 
5.2,  regression  models  were  constructed.*    In  the  regression 
models,  all  two-way  and  three-way  combinations  of  the  CFI 
and  AFI  variables  were  tested,  initially  excluding  those 
variables  that,  on  the  basis  of  the  simple  correlations  were 
not  related  to  gains.**    Also,  the  major  policy  variables 
previously  found  to  be  significantly  related  to  cognitive 
gains  (group  size,  proportion  of  caregivers  with  speciali- 
zation, and  mean  years  of  caregiver  experience)  were  included. 
Finally,  covariables  were  initially  used  to  control  for 
possible  confoundings  of  race  of  children  in  the  center  and 
SES  characterisics  of  the  center,  although  as  in  the  other 
cognitive  analyses,  they  were  subsequently  found  to  be 
nonsignificant. 

In  addition  to  using  simply  weighted  least  squares 
to  estimate  regression  surfaces,  all  models  were  also 
estimated  using  weighted-biwe ighted  least  squares .     Biwe ight- 
ing  is  a  robui^t  estimation  technique  designed  to  handle  data 
where  there  may  be  severe  departures  from  the  normality 

*  As  was  done  with  the  correlations,  regressions  were  weighted 
by  the  appropriate  number  of  children.     In  addition,  centers 
previously  determined  to  be  outliers  were  not  included  in 
this  analysis. 

**Process  variables  that  had  nonsignificant  simple  correlations 
were  subsequently  entered  into  regression  models  to  further 
investigate  their  behavior.     Without  exception,  these  vari- 
ables remained  nonsignificant. 
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assumptions  that  are  generally  made  in  estimating  the  stan- 
dard general  linear  model.     Large  changes  in  coefficient 
estimates  after  biweighting  indicate  that  the  results  of  the 
simple  least  squares  regression  are  unstable/ 

Regression  Results  for  Observational  Measures 

Several  regression  models  were  constructed  for 
PSI  GAINS,  the  most  informative  of  which  are  presented  in 
Table  5.3.     The  models  reported  in  the  table  all  contain  at 
least  one  CFI  or  AFI  varible  that  had  a  significant  simple 
correlation  with  PSI  GAINS  and  a  significant  regression 
coefficient  whose  direction  of  effect  was  identical  to  that 
of  the  simple  correlation  (or  there  was  a  good  reason  for 
the  difference) . 

The  regressions  essentially  confirm  the  correlational 
result:     centers  in  which  children  more  frequently  engage  in 
reflective  behavior,  cooperate  with  teachers  and  become 
involved  in  thoughtful  tasks  rather  than  wander  tend  to  have 
higher  gains  on  the  PSI;  in  addition,  children  in  classes 
that  are  more  structured  tend  to  have  higher  gains.  The 
stability  of  the  results  for  GROUP  SIZE  in  every  model 
indicates  that  the  importance  of  group  size  for  PSI  gains  is 
indeed  independent  of  other  measures  of  classroom  process. 
The  stability  of  the  regression  coefficients  after  bi- 
weighting further  strengthens  the  validity  of  all  these 
findings.     Note,  however,  that  this  stability  is  due  in  part 
to  the  deletion  of  the  four  outlier  centers.     That  is,  in 
removing  those  centers  which  probably  would  have  caused  the 
biweighted  coefficients  to  differ  from  the  initial  coeffi- 
cients, the  biweighted  coefficients  have  become  more  stable. 

These  models  were  constructed  with  the  intention 
of  describing  as  tersely  as  possible  the  type  of  day  care 
center  which  facilitates  higher  PSI  gains.     Towards  this 
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*Only  those  AFI  and  CFI  variables  which  acted  as  significant  predictors  (e(=  .05)  appear  on  this  table. 
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end,  certain  variables  included  in  the  models  act  as  proxies 
for  a  whole  host  of  variables  not  entered  into  the  model  but 
correlated  with  the  regressors  used.     For  example,  COOPERA- 
TES not  only  indicates  the  degree  to  which  children  tend  to 
cooperate  with  caregivers,  but  also  reflects  the  degree  to 
which  children  receive  input  from  adults,  the  amount  of 
structure  in  the  class  and  also  the  proportion  of  time 
children  spend  focusing  their  attention  towards  other 
children.     By  the  same  principle,  the  variable  RECEIVES 
INPUT,  which  is  not  included  specifically  as  a  regressor  in 
Table  5.3,  is  indeed  a  characteristic  of  centers  with  higher 
PSI  gains.     Due  to  its  correlation  with  many  of  the  other 
variables,  however,  it  was  not  found  to  be  as  strong  a 
regressor  as  CLASS  STRUCTURE  or  COOPERATES,  for  example 
and  as  such  was  not  explicitly  entered  into  the  regression 
models.     Examination  of  the  regressions  in  Table  5.3  in 
conjunction  with  the  correlations  in  Table  5.I  therefore 
permits  an  overall  description  of  center  characteristics 
associated  with  higher  generalized  PSi  gains. 

The  same  approach  was  employed  to  construct 
regression  models  for  PPVT  GAINS;    the  results  of  this 
analysis  appear  in  Table  5.4.     As  the  simple  correlations 
indicated,  many  aspects  of  caregiver  behavior  are  associated 
*with  higher  generalized  gains  on  the  PPVT,  but  only  one  CFI 
variable,  INDIFFERENCE,  is  associated  with  gains.  Centers 
with  higher  PPVT  gains  tend  to  be  characterized  by  more 
one-to-one  caregiver-child  interaction.     These  caregivers 
spend  niore  time  in  both  MANAGEMENT  (commanding  and  correcting) 
and  SOCIAL  ACTIVITY  (more  time  interacting,  and  less  time 
passively  observing  classroom  activities),     m  classes  with 
higher  gains,  teachers  spend  n,ore  time  with  med iu,n-sized 
groups  as  opposed  to  larger  ones;  children  tend  to  be  more 
actively  involved  in  classroom  activities  instead  of  wand- 
ering around  the  class. 


Table  5.4 


RESULTS  OP  WEIGHTED  M)  WEIGHTO-BIWEIGHTED  RBGRESSICMS 
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*Only  those  AFI  and  CFI  variables  which  acted  as  significant  predictors  t?(=  .05)  appear  on  this  table, 
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The  correlations  in  Table  5.2  suggest  that  i^ 
would  be  difficult  to  estimate  the  effects  of  these  differ- 
ent API  variables  were  several  of  them  to  be  included  in  a 
single  regression.     The  final  model  displayed  in  Table 
5.4  shows  this  not  to  be  the  case,  however,     it  seems  as 
though  the  pattern  of  positive  and  negative  correlations 
among  the  regressors  -push  and  pull-  against  each  other  in 
such  a  manner  that  the  coefficient  estimates  obtained  in  the 
more  inclusive  model  are  strikingly  similar  to  those  obtained 
in  simpler  models.     The  initial  and  biweighted  coefficients 
in  all  models  are  remarkably  similar,  further  strengthening 
the  stability  of  these  findings.*    That  is,  although  the 
predictor  variables  are  not  truly  independent,  it  is  possible 
to  estimate  their  separate  effects  through  a  single  model. 
(Note  that  it  was  not  possible  to  include  TO  CHILD  in  this 
all-xnclusive  model  because  its  effects  and  those  of  MANAGE- 
MENT and  SOCIAL  ACTIVITY  became  severely  attenuated.  As 
before,  however,  it  is  important  to  keep  in  mind  that  even 
though  TO  CHILD  is  not  explicitly  included  in  most  of  these 
regression  models,  it        included  via  the  two  API  macro-codes 
with  which  it  is  correlated.) 

H^^lgji^gpLatio^  and  other  Center  Charact...- .....  ..... 

With  a  clear  understanding  of  the  relationships 
between  adult  and  child  behavior  and  cognitive  gains  in 
mind.  It  is  now  possible  to  expand  the  scope  of  this  in- 
vestigation to  include  other  center  characteristics  such  as 
director  qualifications,  space  and  center  philosophy.  The 
method  of  investigation  is  essentially  identical  to  that 
used  for  the  first  linkage;  without  restating  the  specific 
details,  discussion  will  begin  with  the  weighted  correlations 
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of  all  variables  correlated  with  the  gains  at  the  .05  level 
or  better.^ 

Correlations  of  Other  Center  Characteristics  and 
Cognitive  Gains 

Tables  5.5  and  5.6  present  the  weighted  correlations 
for  these  additional  center  characteristics  and  the  independent 
variables  used  in  earlier  analyses  for  the  PSI  and  PPVT, 
respectively.    Of  the  many  other  center  characteristics 
listed  in  Appendix  A,  only  one  was  found  to  be  significantly 
elated  to  PSI  GAINS:     COGNITIVE  EMPHASIS   (r  =  0.38).  None 
of  the  physical  environment,  director's  qualifications  or 
CDA  variables  bore  a  significant  relationship  to  PSI  GAINS, 
though  two  of  the  director's  variables  and  one  CDA  measure 
were  related  at  the  .15  level.     In  fact,  each  of  these  three 
lesser  correlations  describe  connections  between  other 
variables  already  included  in  the  description  of  day  care 
centers  associated  with  higher  PSI  GAINS.     For  example,  the 
director  qualifications  variables  are  both  highly  correlated 
with  SPECIALIZATION   (for  staff  in  general);  more  qualified 
directors  are  found  in  centers  where  the  staff  tend  to  have 
better  qualifications  overall. 

Many  additional  center  char,. .:teristics  were  found 
to  be  quite  strongly  related  to  PPVT  GAINS,  however.     Of  the 
center  philosophy  and  program  orientation  variables,  it 
seems  that  centers  with  a  GROUP  ORIENTATION  have  lower  gains 
on  the  average.     This  result  is  tied  to  the  size  of  the 
groups  toward  which  caregivers  focus  their  attention  (GROUP 
SCALE)  and  the  degree  of  interactiveness  (SOCIAL  ACTIVITY). 
Centers  which  have  a  group  emphasis  tend  to  be  organized 
into  larger  groups  and  caregivers  tend  to  interact  less  with 
these  groups. 

Available  space  does  not  appear  to  be  significantly 
related  to  PPVT  GAINS,  although  there  is  a  slight  indication 
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Table  5.6 

P(Vr  GAINS  WEM  COBREUTIONS 
CBffER  LEVEL  (N°48  TO  52) 
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that  centers  which  have  more  space  available  for  children 
tend  to  have  higher  PPVT  GAINS. 

Variables  from  the  CDA  Checklist  appear  to  be 
strongly  related  to  PPVT  GAINS,  but  it  is  important  to 
note  that  these  relationships  are  highly  correlated  with 
the  AFI  variables,  especially  SOCIAL  ACTIVITY  and  TO  CHILD.* 
Caregivers  who  score  higher  on  CHILD  ORIENTATION,  CDA  SCORE 
and  CLASSROOM  MANAGEMENT  are  those  caregivers  who  spend  more 
time  in  social  interaction  and  with  individual  children. 
Hence  it  appears  that  the  CDA  is  another  source  of  informa- 
tion to  describe  the  interactiveness  of  caregivers. 
RESOURCES  also  appears  to  be  associated  with  PPVT  GAINS, 
implying  that  more  toys  and  creative  play  materials  in  a 
classroom  is  another  bit  of  the  overall  picture  of  quality 
day  care. 

Regression  Results  for  other  Center  Characteristics 

Regression  models  were  constructed  using  the 
additional  center  characteristics  in  conjunction  wit.  those 
variables  previously  found  to  be  related  to  tf;e  gain  scores. 
Results  of  these  analyses  appear  in  Table  5.7  and  5.8. 
centers  where  directors  state  that  there  is  an  emphasis  on 
cognitive  development  tend  to  have  higher  PSI  gain  scores; 
this  result  appears  to  be  fairly  independent  of  other 
behavioral  and  structural  aspects  of  the  center,  m 
addition,  caregivers  with  a  stronger  CHILD  ORIENTATION  as 
measured  by  the  CDA  tend  to  be  found  in  centers  with  higher 
PSI  gains.     Although  this  result  is  not  overwhelmingly 
strong,  it  does  indicate  that  caregiver  behavior  influences 
not  only  PPVT  gains,  but  PSI  gains  as  well. 

Table  5.8  further  emphasizes  the  importance  of  care- 
giver behavior  for  the  PPVT.     Two  variables  from  the  CDA 
Checklist,  CHILD  ORIENTATION  and  CDA  SCORE,  both  contribute 


^See  Goodrich,  1980b,  for  a  more  extensive  discussion. 
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Table  5.7 

RESULTS  OF  WEIGHTED  AND  WBIGHTED-BIWEIGHTED  REGRESSIONS 


DEPENDENT  VARIABLE:   PSI  GAINS 


Weighted- 
Weighted  Bi-weighted 
Independent       Regression  Regression      Simple  « 

Source       ■  Variables       Coefficient      t      p-value    Coefficient  Correlation  _R_ 

N=49 

PHIL      Cognitive  Emphasis 
POL      Group  Size 
CFI  Reflection/Innovation 


1.17 

2.33 

.03 

1.36 

0.38 

0.07 

-2.06 

.05 

-0.07 

0.36 

20.24 

2.70 

.01 

20.39 

0.43 

.34 

N=49 


PHIL 

Cognitive  Emphasis 

1.10 

2.27 

.03 

1.19 

0.38 

POL 

Group  Size 

-0.06 

-2.06 

.05 

-0.07 

-0.36 

CFI 

Reflection/Innovation 

18.06 

2.46 

.02 

19.18 

0.43 

CFI 

Receives  Input 

10.52 

1.94 

.06 

11.96 

0.33 

.39 

N=49 

PHIL 

Cognitive  Emphasis 

0.86 

1.78 

.09 

0.98 

0.38 

POL 

Group  Size 

-0.06 

-1.92 

.07 

-0.06 

-0.36 

CFI 

Reflection/Innovation 

19.27 

2.75 

.009 

18.32 

0.43 

CFI 

Cooperates 

6.36 

2.74 

.009 

6.62 

0.42 

.44 

N=53 

CDA      Child  Orientation  2.08 

POL       Group  Size  -0.07 

CFI       Reflection/Innovation  24.01 


1.71 

.10 

1.92 

0.22 

-2.36 

.03. 

-0.08 

-0.36  . 

3.33 

.001 

24.92 

0.43 

.32 

'PHIL  =  Center  Philosophy  and  Program  Orientation,  POL  =  Policy  Variable, 
CFI  =  Child  Focus  Instrument,  CDA  =  Child  Development  Associates  Checklist. 
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Table  5.8 

Ut^ENDEN^VAklABLti  PPVriSAlNS   


Scarce 


CDA 
AFI 
AFI 
CFI 


^  CDA 


a 


AFI 
AFI 


PHIL 
AFI 


independent 
Variables 

N=51 

Weighted 
Regression 
Coefficient 

t 

p-value 

Weighted 
Di-weigntea 
Regression 
Coefficient 

Simple 
Correlation 

CDA  Score 

8.38 
■5.21 
27.09 
-21.78 

3.51 
-3.30 

4.84 
-3.10 

uioup  Dcaie 

Management 

Indifference 

N=52 

.001 
.001 
.001 
.004 

fl  QQ 

-5.26 
28.08 
-21,43 

0.41 
-0.41 
0.25 

Child  Orientation 
Group  Scale 
Hanagenent 

6.13 
-6.60 
17.79 

2.94 

-3.76 
2.93 

.006 
.001 
.007 

6.66 

-6.56 
18.56 

0.39 
-0.41 
0.25 

Group  Orientation 
Management 

-2.20 
20.96 

-3.18 
3.18 

.003 
.003 

-2.23 
19.92 

-0.32 
0.25 

truinent,  phil  -  Center  Philosophy  and  Program  Orientation. 


R 
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.55 


.39 


.27 
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considerable  information  concerning  caregiver  behavior  to 
this  analysis.     A  separate  measurement  of  caregiver  behavior 
confirms  the  earlier  AFI  finding  that  caregivers  who  are 
more  interactive  and  tend  to  actively  focus  their  attention 
towards  children  are  found  in  centers  with  higher  PPVT 
gains.     Table  5.8  also  shows  that  centers  which  tend  to  be 
oriented  toward  the  group  as  opposed  to  the  individual  tend 
to  have  lower  PPVT  gains.     This  further  refines  the  hypothe- 
sis that  individual  attention  is  a  key  aspect  of  centers 
with  higher  cognitive  gains. 

Additional  Validations 

The  findings  in  this  report  have  been  subjected  to 
extensive  methodological  scrutiny.     Every  attempt  has  been 
made  to  examine  potential  statistical  pitfalls.     In  addition 
to  those  already  described  in  the  text  of  this  report  (such 
as  outlier  examination) ,  several  other  checks  were  made  to 
insure  the  accuracy  and  stability  of  these  results. 

In  addition  to  analyzing  the  data  from  all  57  cen- 
terSr  the  49-center  quasi-experinent  and  the  8-center  Atlanta 
Public  School  substudy  were  examined  separately.*    The  re- 
sults for  the  49-center  experiment  are  essentially  identical 
to  those  for  the  57-center  study.     Coefficient  estimates  are 
remarkably  stable  across  the  two  samples;  estimates  of 
standard  errors  are  slightly. smaller  in  the  49-center  study, 
thus  producing  slightly  stronger  significance  levels. 

Most  important,  biweighting  proved  to  be  a  very 
useful  analytic  tool  for  insuring  that  the  results  are 
not  attributable  to  extreme,  atypical  cases.     In  conjunction 
with  examination  of  scatterplots  and  residuals,  biweighting 
helped  to  validate  findings. 

*For  a  discussion  of  the  results  for  the  APS,  see  Goodrich, 
1980a. 
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CHAPTER  SIX;  CONCLUSIONS 


The  data  provide  clear  evidence  that  there  are 
discernible  patterns  of  child  and  adult  behavior  which  are 
associated  with  children-s  acquisition  of  skills  and  knowledge 
as  measured  by  the  PSI  and  ppvt.     There  is  also  evidence 
that  the  center  philosophy  and  program  orientation  are 
related  to  these  child  outcomes.     However,  the  data  do  not 
strongly  support  the  hypothesis  that  child  behaviors  as 
measured  by  the  CFI  are  directly  linked  to  caregiver  be- 
haviors. 

Size  of  Effective  Subgroups 

One  of  the  major  findings  of  the  NDCS  has  been 
that  small  groups  are  associated  with  better  care  for 
children.     The  process-outcome  analysis  not  only  supports 
this  finding,  but  also  provides  additional  refinements  to 
our  understanding  of  why  group  size  is  such  an  important 
dimension  of  quality  care.     The  total  number  of  children 
present  with  one  or  more  caregivers,  as  measured  by  an 
actual  head  count,  effectively  determines  the  size  of  the 
subgroups  into  which  caregivers  organize  the  classroom. 
AS  the  number  of  children  assigned  to  a  classroom  increases, 
the  size  of  the  subgroups  toward  which  caregivers  focus 
their  attention  increases,  regardless  of  the  prevailing 
staff/child  ratio.     The  size  of  these  "effective  subgroup- 
ings-  IS  associated  with  a  whole  range  of  child  behaviors 
and  outcomes. 

Centers  in  which  caregivers  structure  the  classes 
into  medium-sized  groups  as  opposed  to  large  ones  have 
higher  gains  on  both  PSI  and  PPVT.     Moreover,  there  is 
evidence  that  children  in  these  centers  are  more  actively 
involved  in  activities,  spend  less  time  simply  wandering 
about,  are  more  thoughtful  and  reflective  in  their  projects 
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and  receive  more  Input  from  adults.    When  effective  groupings 
are  large,  caregivers  tend  to  stop  Interacting  with  children 
and  begin  to  stand  back  and  passively  observe  classroom 
activities.     It  appears,  therefore,  that  group  size  does 
Indeed  Influence  child  and  adult  behavior  patterns,  as  well 
as  cognitive  gains. 

Focus  on  an  Individual  Child 

The  structure  of  the  day  care  classroom — as 
measured  by  group  size,  staff  count  and  staff/child  ratio — 
appears  to  have  no  effect  upon  the  proportion  of  time 
caregivers  spend  in  one-to-one  Interaction.    Nonetheless , 
centers  in  which  caregivers  spend  a  large  proportion  of 
their  tine  interacting  with  Individual  children  tend  to  have 
higher  PPVT  gain  scores  than  centers  in  which  caregivers 
tend  to  focus  their  attention  to  groups  of  children. 
From  an  individual  child's  perspective,  however,  the  pre- 
vailing group  size  may  affect  the  amount  of  individualized 
attention  received . 

Caregiver  Interactiveness 

Interactiveness  Is  an  important  dimension  of 
quality  day  care.     Centers  in  which  caregivers  are  more 
interactive  and  orient  themselves  towards  children  tend  to 
have  higher  cognitive  gains,  especially  on  the  PPVT. 
Further,  caregivers  who  stand  back  and  passively  observe 
chilc?ren  Instead  of  Interacting  with  them  are  found  in 
centers  with  lower  cognitive  gains.     Although  the  type  of 
interaction  may  be  either  managerial  (commanding  and  cor- 
recting) or  social  in  nature,  social  Interaction  is  the 
stronger  predictor.     In  fact,  the  amount  of  social  interac- 
tion bears  the  strongest  relationship  to  cognitive  gains  of 
any  variable  examined. 
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Classroom  Structure 


The  degree  to  which  classes  are  organized  Into 
structured  activities  as  opposed  to  open-ended,  expressive 
ones  influences  a  range  of  child  and  adult  behaviors  and 
outcomes.     m  the  more  structured  environments  children  are 
more  involved  in  tasks,  receive  nore  l„put  from  adults  and 
exhibit  more  cooperative  behavior,     m  the  more  open  classes, 
adults  respond  to  and  comfort  children  more  frequently,  and 
children  persist  longer  at  tasks  and  pay  .ore  attention  to 
other  Individual  children.     Both  these  sets  of  activities 
seem  intuitively  appropriate  for  the  degree  of  structure  in 
the  Classes  and  in  that  sense  validate  the  observations. 

Child  Involvement 

Children  who  are  active  and  integrated  into  the 
Classroom  activities  have  higher  cognitive  gains  on  both 
instruments.     Moreover,  centers  in  which  children  spend  a 
large  proportion  of  their  time  wandering  have  lower  gains  on 
the  average.     That  is,  there  is  a  distinct  pattern  of  child 
behavior  characterized  by  such  behaviors  as  moving  with 
purpose,  contemplating  and  cooperating  which  tend  to 
be  associated  with  less  time  spent  wandering  as  well  as 
higher  gains.     Caregivers  in  classes  where  children  are 
found  wandering  about  tend  to  exhibit  n,ore  management 
behaviors,     m  this  situation,  however,  it  is  difficult  to 
determine  whether  adult  behavior  influences  child  behavior 
or  vice  versa. 

Cognitive  Emphasis 

Centers  in  which  directors  and  other  staff  expli- 
citly stated  that  there  was  an  emphasis  on  cognitive  develop- 
ment techniques  such  as  language  stimulation  and  teaching 
the  alphabet  and  number  concepts  tended  to  be  characterized 
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by  higher  cognitive  gains.    This  demonstrates,  in  effect, 
that  centers  with  this 'emphasis  have  achieved  their  goals; 
if  academic  preparation  and  school  readiness  were  program 
goals  and  if  the  psi  and  PPVT  measure  these  qualities,  then 
these  centers  appear  to  have  been  successful. 

Individual  Orientation 

Centers  which  were  described  as  having  an  indivi- 
dual emphasis  stressing  the  child's  personal  developnent  in 
such  areas  as  independence,  self-reliance  and  self-esteem 
had  somewhat  higher  PPVT  gains  on  the  average  than  centers 
which  stressed  children  as  part  of  the  group.  Moreover, 
caregivers  in  centers  with  an  individual  orientation  tend  to 
spend  more  time  in  social  interaction  with  children  whereas 
in  centers  with  a  group  orientation,  social  activity  between 
caregiver  and  children  was  low.     Effective  group  sizes  also 
tended  to  be  larger  in  those  centers  which  had  a  group 
emphasis,     it  appears,  therefore,  that  there  is  indeed  a 
center  philosophy  about  caregiving  which  permeates  most 
aspects  of  adult  behavior.     That  is,  when  a  director  describes 
a  center  as  having  a  particular  philosophy  or  orientation, 
there  are  many  recognizable  facets  of  that  orientation  that 
emerge  in  both  adult  behavior  and  child  outcomes. 

Director  Qualifications 

There  is  little  evidence  to  support  the  associa- 
tion of  director  qualifications  with  cognitive  gains. 
Analysis  has  suggested  that  directors  who  have  had  courses 
in  child  development  or  related  fields  tend  to  be  found  in 
centers  with  higher  psi  gains;  however,  the  effect  is 
reversed  for  the  PPVT,  and  none  of  the  correlations  are 
statistically  significant.     As  a  result,  the  findings  for 
this  cluster  of  variables  are  essentially  null.     Since  the 
director  cannot  be  expected  to  serve  as  a  composite  of  the 
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caregivers  observed  In  her  center,  and  Is  limited  in  the 
Insistence  she  can  make  that  her  caregivers  and  children 
Should  behave  in  specified  way,  the  lack  of  associations  in 
this  area  is  not  problematic. 

Physical  Environment 

AS  with  director  qualifications,  there  appears  to 
be  little  relationship  between  the  amount  of  space  available 
m  the  day  care  center  and  cognitive  gains,     it  is  not  the 
number  of  square  feet  in  a  center  that  influences  behavior, 
but  the  way  in  which  that  space  is  used. 
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FOOTNOTES 


1.  The  results  of  the  CFI  variance  components  analysis  appear 
in:     J.  Singer,  D.  Affholter  and  R.  Goodrich,  "Variance 
Components  and  the  Dependability  of  Measures  used  in  the 
National  Day  Care  Study",  Chapter  4,  Abt  Associates,  1978. 

2.  A  discussion  of  the  differences  between  teacher  and  aide 
behavior  appears  in:    National  Day  Care  Study  Phase  II 
Research  Report,   (Cambridge,  MA:     Abt  Associates,  1977), 
Chapter  4. 

3.  For  a  more  complete  discussion  of  this  approach  to 
regression,  see  Goodrich  and  Singer,  1980. 

4.  Biweighting  and  its  uses  in  the  NDCS  is  discussed  in 
more  detail  in  Goodrich  and  Singer,  1980,  Appendix  III. 

5.  Once  again,  several  outlier  centers  have  been  deleted 
from  this  analysis.     In  addition,  note  that  these 
analyses  are  based  upon  a  slightly  smaller  sample  size 
due  to  missing  data. 
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APPENDIX  A 

LIST  OF  ALL  VARIABLES  INCLUDED  IN  PROCESS-OUTCOME  ANALYSIS 


(1)     ADULT-FOCUS  INSTRUMENT 


TO  STAFF 
TO  CHILD 

TO  SMALL  GROUP 

TO  MEDIUM  GROUP 

TO  LARGE  GROUP 

COMMANDS 
CORRECTS 
DIRECT  QUESTION 

RESPONDS 
INSTRUCTS 
ADULT  ACTIVITY 

COMFORTS 

PRAISES 

OBSERVES 

AFI  CHILD  COUNT 

AFI   STAFF  COUNT 


Proportion  of  time  teacher  focuses 
attention  to  other  staff  members. 

Proportion  of  time  teacher  focuses 
attention  to  an  individual  child; 
i.e. ,  one-to-one  interaction. 

Proportion  of  time  teacher  focuses 
attention  to  a  small  group — defined 
as  2-7  children. 

Proportion  of  time  teacher  focuses 
attention  to  a  medium  group — defined 
as  8-12  children. 

Proportion  of  time  teacher  focuses 
attention  to  a  large  group — defined 
as  13  or  more  children. 

Self-explanatory. 

Self-explanatory. 

Proportion  of  time  teacher  poses  a 
direct  question,  e.g.,  "What  is  your 
favorite  color?" 

Self-explanatory. 

Self-explanatory. 

Proportion  of  time  teacher  engages  in 
self-related  activity  or  conversation 
with  other  adults. 

Self-explanatory . 

Sel f-explana to  ry • 

Proportion  of  time  teacher  spends 
listening  to  or  observing  others. 

Number  of  children  with  teacher  at 
the  beginning  of  the  FMI . 

Number  of  staff  present  (including 
teacher)  at  the  beginning  of  the  FMI* 
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APPENDIX  A  (continued) 


(8)     CENTER  PHILOSOPHY 


GUIDANCE  EMPHASIS 

PROTECTIVE  EMPHASIS 

BEHAVIORAL  SUPERVISION 
EMPHASIS 

COGNITIVE  EMPHASIS 

(9)  COVARIABLES 
NUMBER  OF  ADULTS 

NUMBER  OF  CHILDREN 
UNDER  12 

NUMBER  OF  SIBLINGS 
INCOME 

MOTHER'S  EDUCATION 
PSI  INTERVAL 

PPVT  INTERVAL 

FRACTION  BLACK 
FRACTION  MALES 
AGE 

STAFF  AGE 

STAFF  FRACTION  BLACK 
STAFF  FRACTION  FEMALE 


AND  PROGRAM  ORIENTATION  (continued) 
As  described  in  Chapter  2. 
As  described  in  Chapter  2. 
As  described  in  Chapter  2, 

As  described  in  Chapter  2. 


Average  number  of  adults  in 
children's  homes. 

Average  number  of  children  less 
than  12  years  in  children's  homes. 

Average  number  of  siblings. 

Average  family  income. 

Mean  mother's  years  of  education. 

Average  number  of  days  between 
the  two  tests  upon  which  PSI 
GAIN  is  based. 

Average  number  of  days  between 
the  two  tests  upon  which  ppvT 
GAIN  is  based. 

Fraction  of  black  children. 

Fraction  of  male  children. 

Average  age  of  children  (in  months) 

Average  staff  age. 

Fraction  of  black  st*aff. 


Fraction  of  white  staff. 
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APPENDIX  A  (continued) 


(6)     DIRECTOR  QUALIFICATIONS 

DIRECTOR'S  EDUCATION  Director's  years  of  education 


DIRECTOR'S  HIGHEST 
DEGREE 


Director's  highest  degree 
(ordinal  scale) • 


DIRECTOR'S  SPECIALIZATION     Indicates  whether  or  not  director 

had  courses  in  subject  matter 
related  to  children  and  child  care. 


DIRECTOR'S  PREVIOUS  DAY 
CARE  EXPERIENCE 


DIRECTOR'S  CENTER 
EXPERIENCE 


Director's  number  of  years  of 
experience  in  center-based  day 
care  other  than  present  center. 

Director's  number  of  years  in 
current  center. 


(7)     PHYSICAL  ENVIRONMENT 


HOMEROOM 


Play  space  designated  as  belonging 
to  the  target  class  of  children 
(in  square  feet) . 


CLASSROOM  SPACE 
CHILD  SPACE 
INDOOR  SPACE 
OUTDOOR  SPACE 


Center  space  in  daily  use  by 
any  of  the  target  classes. 

All  space  in  center  used  daily 
by  any  of  the  target  classes. 

All  center  space  dedicated 
to  day  care  use. 

Space  designated  as  play  area 
for  the  day  care  children. 


(8)  CENTER  PHILOSOPHY  AND  PROGRAM  ORIENTATION 
INDIVIDUAL  ORIENTATION 


GROUP  ORIENTATION 


ETHNIC  EMPHASIS 


Indicates  centers  oriented 
towards  the  individual . 

Indicates  centers  oriented 
towards  the  group. 

Indicates  centers  with  an 

ethnic  and/or  religious  emphasis. 
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APPENDIX  A  (continued) 


(4)     POLICY  VARIABLES* 
GROUP  SIZE  ^' 
STAFF/CHILD  RATIO 

SPECIALIZATION 


PREVIOUS  DAY  CARE 
EXPERIENCE 


CENTER  EXPERIENCE 


Observed  group  size. 

Ratio  of  observed  number  of  staff  to 
observed  number  of  children. 

Proportion  of  staff  present  who  have 
specialized  courses  in  subject  matter 
related  to  children  and  child  care. 

Mean  years  of  experience  observed 
staff  had  in  center-based  day  care 
other  than  the  center  in  which  they 
presently  work. 

Mean  number  of  years  that  staff 
present  had  worked  in  current 
center.  


(5)      CHILD  DEVELOPMENT  ASSOCIATES  CHECKLIST 


CD A  SCORE 


CHILD  ORIENTATION 


CLASS  MANAGEMENT 


RESOURCES 


ENVIRONMENT 


Overall  CDA  rating  of  caregiver 
competency. 

The  degree  to  which  caregiver  encourages 
cognitive  and  language  development,  a 
good  self-concept  in  children,  social 
behavior,  self-help  behaviors,  and 
active  play. 

The  degree  to  which  caregiver  manages 
class  activities  well  and  emphasizes 
Safety. 

The  degree  to  which  gross  motor  toys 
and  creative  play  materials  are 
available  and  arranged  successfully. 

The  degree  to  which  classroom  environ- 
ment is  safe  and  sanitary. 


"All  policy  variables  refer  to  observations  made  of  the 
tSf  "r^^f  ^"<^,<^^il<^"n  present  for  eaJh  class  dSring 

the  morning  hours  (9:00,  10:00  and  11:00)  on  each  of  two 
days  in  each  of  five  months  in  the  Phase  III  ve^r 
qualifications  of  these  observed  staff  ^      '  ^ 
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APPENDIX  A  (continaed) 


(2)     CHILD-FOCUS  INSTRUMENT  (continued) 

TASK  PERSISTENCE  Measure  of  task  persistence — duration 

of  longest  activity  during  observation* 

COOPERATES  Measure  of  the  degree  to  which 

children  cooperate. 

ATTENTION  TO  ADULT  Proportion  of  time  child  focuses 

attention  to  adult. 

ATTENTION  TO  CHILD  Proportion  of  time  child  focuses 

attention  to  another  child. 

ATTENTION  TO  ENVIRONMENT      Proportion  of  time  child  focuses 

attention  to  the  environment. 

ATTENTION  TO  GROUP  Proportion  of  time  child  focuses 

attention  to  a  group. 

CFI  CHILD  COUNT  Number  of  children  present  at  the 

beginning  of  the  CFI  observation. 

CFI  STAFF  COUNT  Number  of  staff  present  at  the 

beginning  of  the  CFI  observation. 

CFI  RATIO  Computed  as  CFI  STAFF  COUNT  divided 

by  CFI  CHILD  COUNT. 


(3)     COGNITIVE  TESTS* 

PSI  GAIN  Generalized  gain  score  for  the  PSI. 

PPVT  GAIN  Generalized  gain  score  for  the  PPVT 

(adjusted  for  the  covariable  RACE  at 
the  child  level.) 


*  These  gain  scores  were  recalcul 
included  in  the  process-outcome 
that  described  in  Goodrich  and 


ated  for  the  sample  of  children 
analysis  in  the  same  manner  as 
Singer,  1978. 
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APPENDIX  A  (continued) 


(1)     ADULT-FOCUS  INSTRUMENT  (continued) 


API  RATIO 


Computed  as  API  STAPP  COUNT  divided 
by  API  CHILD  COUNT. 


(2)  CHILD-POCUS  INSTRUMENT 
OPEN  ACTIVITY 


CLOSED  ACTIVITY 


MONITORS  ENVIRONMENT 


CONSIDERS 


ADDS  PROP 


WANDERS 


MOVES  WITH  PURPOSE 

VERBAL  INITIATIVE 

NON-INVOLVEMENT 
RECEIVES  INPUT 


Proportion  of  time  spent  in  open- 
ended,  expressive  activity. 

Proportion  of  time  spent  in  closed, 
structured  activity. 

Proportion  of  time  spent  monitoring 
environment;  child's  attention  is 
obviously  directed  at  other  people 
or  things. 

Proportion  of  time  spent  considering, 
contemplating,  tinkering;  e.g.,  child 
struggles  with  a  problem  attempting  to 
solve  it. 

Proportion  of  time  child  adds  a  dif- 
ferent prop  or  new  idea,  i.e.,  variety 
to  his/her  activity. 

Proportion  of  time  spent  wandering 
around  center  with  no  apparent  purpose 
to  his/her  movement.     Child  may  be 
sitting  or  standing  doing  nothing, 
looking  around  the  area  with  no 
apparent  focus. 

Proportion  of  time  child  moves  with 
purpose;  child  is  going  from  one 
activity  to  another;  evident  that 
there  is  some  goal  to  movement. 

Proportion  of  time  child  gives 
opinions,  comments,  information  or 
states  preferences. 

Proportion  of  time  spent  in  no  apparent 
task  or  activity. 

Proportion  of  time  child  receives 
input  from  adults. 
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CHAPTER  ONE:  INTRODUCTION 


This  report  presents  the  design,  implementation, 
and  analysis  of  a  randomized  experiment  in  eight  Atlanta 
Public  School  (APS)  day  care  centers.*    The  purpose  of  the 
experiment  was  to  test  the  hypothesis  that  staff/child  ratio 
and  level  of  staff  education  significantly  affect  caregivers' 
skills  and  behaviors,  children's  behaviors  and  children's 
cognitive  development,  as  measured  by  the  Preschool  Inventory 
(PSI)  and  the  Peabody  Picture  Vocabulary  Test  (PPVT)  tests 
The  classroom-level  factorial  design  extends  over  eight 
centers,  crosses  three  levels  of  staff  education  with  two 
levels  of  staff/child  ratio  and  is  blocked  on  child  age 
(three-  and  four-year  olds).     Experimental  manipulation, 
including  random  assignment  of  children  to  classes,  was 
conducted  entirely  within  centers. 

In  this  paper,  the  results  of  classroom-level 
analyses  of  the  effect  that  staff/child  ratio  and  level  of 
staff  eduction  have  on  children's  behavior  and  cognitive 
development  are  summarized.     The  manipulations  required  to 
implement  the  study  design  also  are  derived  and  the  problems 
encountered  in  implementing  the  study  are  discussed.  Addi- 
tional classroom-level  regression  analyses  of  the  APS  data 
that  do  not  depend  on  randomized  assignments  and  that 
include  other  policy  variables  (group  size,  number  of  care- 
givers center  experience,  previous  day  care  experience)  are 
reported  in  the  paper  -Effects  of  Day  Care  in  Eight  Atlanta 
Public  Schools  Day  Care  Centers,"   (N.  Goodrich,  1980). 

^''^"'^         °f  the  people  associated  with 
Jarttculf?L'nr  f"*^?"  "^o  made  this  experiment  possJSle, 
f"  iese"Jh  a^d  ^"^^^^^t  Superintendent  ' 
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The  APS  centers  presented  a  unique  situation 
which  made  it  possible  to  implement  a  tandomized  experiment: 


•  The  centers  operated  under  one  auspice,  with 
similar  staffing  patterns,  ratio  requirements 
and  funding • 

•  The  centers  included  in  the  study  served 
entirely  black,  low  SES  children  and  had  only 
black  staff  in  three-  and  four-year  old  class- 
rooms. 

•  Most  of  the  centers  were  sufficiently  large  to 
allow  random  assignment  of  children  to  classrooms 
within  center. 

•  Levels  of  staff  education  were  clearly  defined 
because  of  common  educational  requirements 
corresponding  to  job  role:     in  the  eight  study 
centers,  directors*  had  a  graduate  education  in 
areas  pertaining  to  young  children  (MA),  lead 
teachers  had  completed  a  two-year  day  care 
program  at  Atlanta  Area  Technical  School  (AAT) 
and  aides  had  no  day  care-oriented  education 
beyond  high  school  (HS)  except,  in  some  cases, 
for  a  60-hour  day  care  training  course  required 
by  the  State  of  Georgia  for  caregivers  who  have 
worked  in  centers  for  three  years. 

•  The  centers  operated  additional  day  care 
programs  for  infants  and  older  children,  so 
that  staff/child  ratios  could  be  lowered  by 
transferring  staff  to  these  programs  if  necessary. 

•  The  APS  administration  was  willing  to  permit 
staff  transfers,  job  redefinitions  and  random- 
ized child  assignments  to  implement  a  randomized 
factorial  experimental  design. 


Given  this  homogeneous  and  supportive  environment, 
it  was  possible  to  develop  meaningful  experimental  variations 
in  education  (MA  vs.  AAT  vs»  HS)  and  ratio   (1:5  vs.   1:10)  at 
the  classroom  level,  with  children  randomly  assigned  to 
classes  within  center.     Since  day  care  classrooms  are 


*The  job  titles  used  in  this  report  are  not  the  same  as 
these  used  by  the  Atlanta  Public  Schools.     In  the  APS 
centers  directors  have  the  job  title  "teacher"  while  lead 
teachers  are  referred  to  as  "group  leaders".    Aides  are 
called  aides  both  in  the  APS  centers  and  in  this  report.  . 
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usually  organized  Into  classrooms  by  age,  the  design 
was  blocked  by  age. 


in  the  remainder  of  this  report,  the  manipulations 
required  to  effect  the  design  are  described,  problems 
with  design  Implementation  are  discussed,  and  results 
from  the  data  analysis  are  presented,     it  is  shown  that 
although  there  were  significant  classroom  effects  for 
PSI  (but  hot  PPVT)  generalized  gain  scores,  little  of  this 
variance  could  be  attributed  to  either  staff/child  ratio  or 
level  of  staff  education. 
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4.2. 


CHAPTER  TWO;     EXPERIMENTAL  DESIGN 


The  APS  study  Is  based  on  a  two-way  factorial 
design  that  crosses  three  levels  of  sta.f f  education  and  two 
levels  of  staff  child  ratio.    Treatments  were  defined  for 
29*  classrooms  distributed  over  eight  relatively  hojnogeous 
centers.    Children  were  randomly  assigned  to  classes  within 
center  according  to  age  (three*  and  four»year  olds). 

Although  the  APS  centers  are  quite  similar  In 
many  respects.  It  Is  possible  that  center  differences 
contributed  to  differences  In  children's  cognitive  development. 
Such  an  effect  would  preclude  conventional  two-way  analyses 
of  variance.     (Adjustments  for  center-level  effects  would 
have  to  be  made  In  the  analyses.)     The  existence  of  a 
center  effect  Is  testable  through  a  variance  component 
analys*  -     i-^t  compares  wlthln-center  to  across-center 
varlat  Although  the  statistical  power  of  these  analyses 

is  not  great,  it  is  sufficient  to  detect  medium  to  large 
differences   (1-1/2  to  2  points)   in  children's  PSI  and  PPVT 
gain  scores. 

The  basic  APS  design  is  depicted  in  Figure  2.1. 
Since  the  experimental  ratio  differences  were  obtained 
primarily  by  varying  the  number  of  caregivers  in  a  classroom, 
staff/child  ratio  and  number  of  f^aregivers  are  confounded  in 
the 'design.    To  the  extent  possible,  two  other  major  policy 
variables—group  size  and  years  of  experience—are  balanced 
across  cells.     In  addition,  no  two  cells  contain  the  same 
combination  of  centers.    A  detailed  representation  of  the 
design  showing  classes,  numbers  of  staff  and  children 
and  average  years  of  experience  is  presented  in  Figure  2.2. 


*An  additional  classroom  was  added  in  one  center  after 
randomization  was  effected.    This  classroom  was  included 
in  analyses  that  were  not  based  in  the  randomized  portion 
of  the  design* 
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Figure  2.1 
APS  DESIGN 


Educational  Level 


Staffs 

Child 

Ratio 


1:5 
1:10 

1:5 
1:10 


2  classes 

2  classes 

2  classes 

2  classes 

2  classes 

2  classes 

2  classes 

5  classes 

4  classes 

2  classes 

2  classes 

2  classes 

Three- 
Year- 

Olds 


Four- 
Year- 

Olds 


Although  most  children  spent  between  seven  and 
ten  hours  a  day  at  the  APS  centers,  the  study  focused  only  on 
the  core  morning  hours  (9:00  a.m.  to  12:00  p.m.).     it  is 
during  this  time  that  the  children  actively  participate  in  a 
day  care  program.    Outside  these  hours  children  are  primarily 
involved  in  arrival,  departure,  mealtime  or  naptime— 
situations  in  which  it  is  difficult,  if  not  impossible,  to 
maintain  classroom  distinctions  and  treatment  contrasts. 

The  three  education  levels  (MA,  AAT,  HS)  included 
in  the  design  were  obtained  by  temporarily  redefining  job 
roles  for  some  staff  members.    Directors,  who  usually 
assisted  in  all  classes  as  needed,  were  responsible  for  one 
(high  education)  classroom.    Ten  aides  were  promoted  to 
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Figure  2.2 
DeTAII£D  APS  DESIGN 
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acting  lead  teacher  (low  education)  positions  for  the 
duration  of  the  study  year  (October  1976  -  June  1977) ,  with 
appropriate  salary  Increases  paid  by  the  study,     m  the 
remaining  (medium  education)  classrooms,  lead  teachers 
continued  In  their  previous  job  roles,     since  18  new  lead 
teacher  positions  were  created  for  the  study,  a  correspond- 
ing number  of  former  lead  teachers  were  asked  to  act  as 
aides  In  either  high  or  medium  education  classrooms.  These 
staff  continued  to  receive  lead  teacher  salaries. 

Two  staff  child  ratio  contrasts— i : 5  (high)  and 
1:10  (low)— also  were  created  for  the  study.    These  were 
obtained  by  assigning  approximately  ten,  fifteen  or  twenty 
children  and  one  to  four  caregivers  to  each  class,  since 
the  APS  centers  operated  at  an  average  ratio  of  1:7,  few 
staff  reasslgnments  to  other  programs  were  necessary. 

To  obtain  appropriate  ratio  contrasts  by  age,  the 
birth  date  for  determining  three-  and  four-year-old  classes 
varied  by  center,     children  born  between  January  1,  1972  and 
October  1,  1972  were  assigned  to  four-year-old  classrooms, 
children  born  between  January  1,  1973  and  December  31,  1973 
were  assigned  to  three-year-old  classrooms,  and  children 
born  between  October  1,  1972  and  December  31,  1972  were 
assigned  to  either  three-  or  four-year-old  classrooms  as 
needed  to  effect  the  ratio  contrasts.    Although  this  resulted 
in  uneven  age  distinctions  across  centers,  there  was  no 
systematic  age  bias. 
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CHAPTER  THREE;  IMPLEMENTApPN 


Throughout  the  study  year,  classrooms  were  periodi- 
cally observed  and  rostered  to  provide  information  about  the 
on-going  day  care  process.     This  data  base  also  provided 
information  about  the  extent  to  which  the  APS  design  was 
implemented  during  the  year.     If  the  data  indicated  that  the 
specified  treatment  was  not  delivered  to  one  or  more  classes, 
it  was  important  to  revise  the  design  to  reflect  the  true 
situation  before  the  effects  of  staff/child  ratio  and  staff 
education  were  tested.     Based  on  these  data,  treatment 
designations  were  changed  for  several  classes  before  analyses 
were  undertaken.     The  revised  design  is  shown  in  Figure  3.1. 

Level  of  education  was  changed  from  "medium"  to 
"low"  for  one  classroom  because  initial  information  about 
the  lead  teacher's  education  was  incorrect.     Since  level  of 
education  is  defined  by  the  type  of  education  obtained  by 
the  lead  teacher,  assignments  to  education  levels  were  based 
on  independent  knowledge  about  the  type  of  schooling  obtained 
(MA,  AAT,  HS)   rather  than  on  observed  years  of  education  or 
highest  degree.     Nonetheless,  there  are  differences  in  the 
averages  of  the  two  observed  education  variables  across 
levels  which  tend  to  verify  that  education  contrasts  were 
implemented. 

Information  obtained  informally  from  center  staff 
indicated  that  the  lead  teachers  designated  by  the  study 
were  in  charge  of  their  assigned  classrooms  during  the  year. 
However,  in  two  "high"  level  of  education  classes  (centers  F 
and  H) ,  the  directors  were  reported  to  have  spent  a  minimal 
amount  of  time  actually  working  with  the  children  in  their 
assigned  classes.     This  fact  is  reflected  in  the  low  observed 
education  figures  for  these  classes.     Thus,  there  is  evidence 
that  the  classes  could  have  been  reassigned  to  a  "medium" 
level  of  education.     They  were  retained  as  "high"  primarily 
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because  the  directors  continued  to  plan  the  classes,  even 
though  they  did  not  participate  to  the  desired  degree. 

Nine  classes  were  assigned  to  new  ratio  levels 
based  on  the  observed  ratio  data.     Consequently,  two  pairs 
of  treatment  cells  include  the  same  combination  of  centers. 
While  this  situation  results  in  an  undesirable  confounding 
of  center  and  treatment  for  the  four  affected  cells,  analyses 
based  on  the  implemented  design  will  not  be  misleading  if  a 
systematic  center  effect  does  not  exist. 

The  ratio  contrasts  actually  implemented  in  the 
APS  centers  are  not  as  great  as  specified  in  the  design. 
The  average  "high"  ratio  was  1:5.38  and  varied  from  1:4.24 
to  1:6.21,  while  the  average  "low"  ratio  was  1:7.41,  ranging 
from  1:6.37  to  1:9.01.    While  the  ratio  level  differences 
are  extremely  significant  (p<.001),  the  contrasts  must  be 
interpreted  as  being  1:5  vs.  1:7  rather  than  1:5  vs.  1:10. 

There  are  two  probable  reasons  for  the  less 
distinct  ratio  contrasts.     First,  the  ratio  observations 
often  included  a  free-play  situation  in  which  children  from 
several  classes  were  merged  on  a  playground  or  in  one  large 
area.     Ratios  for  all  classes  would  be  approximately  the 
same  in  this  situation,  tending  to  regress  toward  the  mean 
for  the  center.    Also,  several  centers  were  assigned  extra 
student  interns  or  other  staff  after  the  APS  study  began. 
These  staff  generally  were  used  in  support  activities  not 
directly  involved  with  teaching  (toileting  children,  setting 
up  activities  or  lunch,  etc.).     it  is  likely  that  the  extra 
staff  assisted  more  often  in  low  ratio  classes,  effectively 
increasing  both  observed  and  actual  ratios. 
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CHAPTER  FOUR-  ANALYSIS 


Three  types  of  analyses  were  undertaken  based 
on  the  APS  study  design: 

^'    tS^i^^r  examined  a  subset  of  random- 

^.h  '^^"t^'^  to  determine 

a    the  existence  of  a  center  effect, 
b    the  existence  of  a  classroom  effect,  and 
icj  tne  variance  components  associated  with 

2.  Analyses  of  variance  based  on  the  revised 
ft^5f/.h?i^^^^''?^"^         effects  of  level  of 
aid  fhf  fiJ  "^i?'  ^r^^  °^  =t^"  education 
h21  J    Interaction  between  the  two  indepen- 
dent variables. 

3.  Regression  analyses  which  used  a  continuous 
observed  staff/child  ratio  variable  (see 

^"f         three-level  staff  educa- 
tion design  variable. 

Each  of  these  analyses  represents  a  trade-off  between  statis. 
tical  power  and  design  validity.     For  this  reason,  multiple 
analysis  techniques  were  used  to  examine  thoroughly  the 
existence  of  a  treatment  effect. 

Dependent  variables  for  the  analyses  were 
children's  PSI  and  PPVT  generaliz.e  gain  scores  (Goodrich 
and  Singer,  1980).     The  analyses  of  variance  also  examined 
caregivers,  and  children's  classroom  behavior  as  observed 
during  the  spring  of  1977.      Careg.  *,er  behaviors  were 
recorded  using  the  Adult  Focus  Observation  Instrument 
(Goodson,  1980);  caregiver  skills  we -e  measured  through  a 
checklist  based  on  th.  child  D^ve   .p„ent  Associates  (CDA) 
credentlaling  system  fN.  Goc-rlr-     198O);  and  children's 
behaviors  were  indicated  on  cne  Child  Focus  Observation 
Instrument  (Connell,  i960). 
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TwO"fold  Nested  Classification  Analysis 


Although  the  APS  experimental  design  is  basically 
a  2  X  3  factorial,  the  design  extends  over  several  centers, 
and  experimental  manipulation  is  entirely  within  center. 
The  most  statistically  powerful  analysis  for  treatment 
effects  is  the  conventional  two-way  ANOVA,  but  if  there  are 
center  effects  on  cognitive  gains  (except  through  classroom 
level  factors) ,  the  design  is  not  appropriate.  Center 
effects  may  arise  because  of  differences  attributable  to  the 
center  itself.     In  addition,  since  children  were  randomly 
assigned  to  classes  only  within  center,  there  may  remain 
systematic  differences  in  the  children  served  by  centers.  A 
two*fold  nested  classification  analysis  (Graybill,  1961) 
avoids  these  technical  problems  but  does  so  at  the  expense 
of  reduced  statistical  power. 

The  statistical  model  is  the  random  effects  model 

V  u     ct        6  e 

^ijk  =   ^  +    i  +  '^ij  +  ^ijk, 

where  effects  in  the  model  are  given  by 


y       =  grand  mean 
^i      =  center  effect 
^ij     =  classroom  effect 
®ijr  =  child/error  effect 


while  the  index  structure  and  experimental  design  are 
specified  by 
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i 

reenter  index 

j 

(■ 

classroom-within-center  index 

k 

wtiAAu/cLLUi  wi  unin— Class r ooin— 
within-center-index 

number  of  children  in  classroom  j 
(within  center  i) 

h  = 

number  of  children  in  center  i 

K  = 

I  h 

number  of  children  (total) 

number  of  classes  in  center  i 

J  = 

number  of  classes  (total) 

I 

number  of  centers 

The  object  in  analyzing  the  model  is  not  to  estimate  fixed 
classroom  or  center  effects  but  rather  to  estimate  the 
components  of  variance  associated  with  these  sources. 
Results  are  used  to  inform  subsequent  fixed  effect  analyses. 

The  two-fold  nested  design  includes  only  those  24 
classrooms  that  were  actually  involved  in  randomized  assign- 
ments of  children  (see  Table  4.1).    Differences  within 
center  in  either  three-year  old  or  four-year  old  designs  are 
attributable  entirely  to  classroom-within-center  effects 
among  classrooms  in  the  randomized  portion  of  the  design. 
Sources  of  these  effects  include: 


1. 
2. 

3. 

4. 


experimental  manipulation  of  design  factors; 

other  (incompletely  balanced)  classroom 
composition  factors; 

caregiver  effects  unrelated  to  level  of 
education;  and 

experimental  disruption. 
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Table  4.1 


TWO'^FOLD  NESTED  CLASSIFICATION 
EXPERIMENTAL  DESIGN 


Center  Three'^Year  Olds         Four^^Year  Olds 

*A  HL  vs.  ML  MH  vs.  LH 

C  HL  vs.  LL  ML  vs.  LL 

D  HL  vs.  ML  vs.  LL 

E  HL  vs.  ML  MH  vs.  ML  vs.  LH 

F  MH  vs.  LL  HH  vs.  LH 

G  MH  vs.  LL 

H  HL  vs.  LH 


This  design  indicates  that  while  level  of  education  differ* 
ences  were  implemented  for  every  center  within  age  group, 
staff/child  ratio  differences  existed  in  only  four  of  the 
seven  centers  (E,  F,  G,  H)  the  within  age  group.  Thus 
statistical  power  to  test  for  within-center  staff-child 
ratio  effects  is  not  high. 

Estimation  of  Variance  Components 

The  ANOVA  displayed  in  Table  4.2,  was  used  to 
estimate  variance  components  for  the  APS  design.  Results 
from  these  analyses  are  shown  in  Tables  4.3  and  4.4.  F-tests 
and  significance  levels  in  Tables  4.3  and.  4.4  were  computed 
as  follows. 

The  test  for  the  hypothesis  that  a  center  effect 
exists  (a2>0)   is  constructed  in  terms  of  the  statistic 
^ms/*?ms  (see  Table  4.2),  assumed  to  be  distributed  as 
^(I-l,  J-I)  under  the  null  hypothesis    2  =0.    In  the 
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Table  4.2 


ANALYSIS  OF  VARIANCE  FOR  TWO-FflLn 
NESTED  MODEL  

(Symbols  are  defined  as  in  the  random  effects  model) 


_DF_    SS 


MS   EMS 


Centers  i-i  ?      /v       v      \  ^  ,  2  2 

ijk  Ims        "^e    +  giV  ^2°\ 

Classrooms      .-i  ij,  (V^^  .-V^. .)  ^  a^^  - 

Children         k-J  fj^^^lj^j.)'  " 


ms  e 


91  -  ij  (fli  - 

Kj  K 

92  -  (K  -     i  h)/(l-l^ 

K 
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Table  4.3 


VARIANCE  COMPONENTS   (VC)  ANALYSIS  OF  PSI 
GENERALIZED  GAIL  SCORES 


Three-Year  Olds 
DF  SS  !!§         y£         I  £ 

Centers  3        292.70      97.57        3.78      3.10  .15 

Classrooms  4        126.04      31.51        2.67      2.74  .04 

Children  59        678.42      11.50  11.50 

«  7.49  91  =  8.85  92  »  15.91 


Four-Year  Olds 

DF            SS              MS  yC            F  P 

Centers                     6        244.47      40.74  .31      1.23  .37 

Classrooms                 9        299.00      33.22  2.14      2.50  .01 

Children                 137      1820.54      13.29  13.29 

9-33          91  =  9.70          92  «  21.26 
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Table  4.4 


VARIftNCE  COMPONENTS    (VC)  ANALYSIS  OF  PPVT 
GENKHALIZED  GAIN  SCf^RRS  


Three-Year  oi<is 
DF  SS  MS  VC 


""""""^  3        945.40     315.13       17.59  6.07 

Classrooms  4        207.63      51.91  .32  1.05 

55      2730.26      49.64  49.64 


Children 

9o  =  7.13 


91  =  8.20  92  =  14.94 


Four-Year  Olds 

SS  MS  VC  F 


Cente 


rs 


6        517.89      86.32  (-)  .37 

Classrooms  9        891.07      99.01        2.33  I.27 

Children  132    10269.17      77.80  77.80 

^o  =  9.11  91  =  9.22  92  =  20.51 

{-)   indicates  ne9atlve  estimate  for  vC. 
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unbalanced  case  considered,  this  test  is  approximate,  but 
may  be  appropriate  when       ^^d  gi   (the  parametrs  modi- 
fying the  variance  components  in  Table  4.2)  are  nearly 
equal.    The  test  is  identical  to  the  fixed  effect  ANOVA  test 
for  a  center  effect,  using  the  class  as  unit  of  analysis  and 
weighting  by  children  per  class. 

The  test  for  the  hypothesis  that  a  classroom 
effect  exists  (cj2>o)   is  constructed  from  the  statistic 

*^ms/Kmsr  assumed  to  be  distributed  as  F(J-I,  K-J)  under 
the  null  hypothesis  a2=o.  It  is  equivalent  to  the  fixed 
effect  ANOVA  test  for  a  classroom  effect  using  within-center 
deviations  from  the  mean. 

Results  for  the  PSI   (Table  4.3)   indicate  that 
for  both  three*  and  four-year  olds  the  hypothesis  of  no 
classroom  effect  is  rejected  at  .05  level,  while  the  hypo- 
thesis of  no  center  effect  is  accepted.     However,  the  center 
effect  for  three-year  olds  is  nearly  significant  and  is 
potentially  problematic  for  later?^;i:^inalyses.     It  was  deter- 
mined  to  be  caused  primarily  by  one  outlier  center.  When 
this  center  is  dropped  (Table  4.5),  the  classroom  effect 
is  relatively  unchanged  while  the  EMS  estimate  of  the  center 
component  of  variance  becomes  negative.     This  indicates  that 
if  the  outlier  center  is  dropped,  conventional  ANOVA' s  can  be 
performed  with  little  or  no  danger  of  disruptive  center 
effects. 
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Table  4.5 


VARIANCE  COMPONENTS   (VC)  ANALYSIS  OF  PSI 
GENERALIZED  GAIN  SCORES 

(Outlier  Center  Excluded) 


Three-Year  Olds 

DF  SS  MS  VC 

Centers  2  27.31      13.65  (-) 

Classrooms  3        112.86      37.62  3.28 

Children  45        560.93      12.46  12.46 

=  7.68  gi  =  9.79  g2  =  17.78 


Four-Year  Olds 

51  SS  MS  VC 

Centers  5  70.41      14.08  (-) 

Classrooms  8        298.93      37.37        2.58  2 

119       1608.14      13.51  13.51 

^o  =  9.25  gi  =  9.88  g2  =  22.03 

(-)   indicates  negative  estimate  for  VC. 


Children 
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For  the  PPVT,  the  classroom  level  effect  is 
nonsignificant,  but  there  is  a  center  effect  for  three-year 
olds,  significant  at  the  level  p>«.06  (see  Table  4*6)  •  This 
effect  is  net  removed  by  dropping  the  outlier  center • 
However,  since  it  is  evident  that  the  experimental  manipula- 
tion did  not  create  significant  classroom  level  variance  for 
the  p?VT  in  either  age  group,  it  is  unlikely  that  the  small 
center  effect  for  three-year  olds  will  invalidate  results 
from  pooled  analyses.     For  the  sake  of  completeness,  ANOVA 
and  regression  results  are  presented  for  the  PPVT,  but  they 
only  serve  to  corroborate  the  lack  of  findings. 

Conventional  Analyses  of  Variance 

Analyses  of  variance  (unbalanced)  were  used 
to  examine  the  effects  of  the  design  variables  on  children's 
cognitive  development  (PSI,  PPVT),  caregiver  behaviors 
(AFI) ,  caregiver  skills  (CDA)  and  children's  behaviors 
(CFI) .     The  analyses  were  performed  both  with  and  without 
the  outlier  center.     Results  for  PSI  and  PPVT  gain  scores 
are  shown  in  Tables  4.7  to  4.11;  results  for  CFI,  AFI,  and 
CDA  variables  are  summarized  in  Table  4.12. 

For  several  reasons,  these  ANOVAs  are  of  potentially 
greater  statistical  power  than  the  nested  design  considered 
earlier.     First,  they  include  all  30  classes  rather  than  the 
subset  of  24  randomized  classes.     Second,  dependent  measures 
are  not  corrected  for  center  effects,  so  that  the  variance 
of  independent  measures  includes  existing  (non-experimental) 
differences  among  centers.     Finally,  tests  for  specific  main 
effects  (e.g.,  staff-child  ratio)   use  only  one  degree  of 
freedom  for  the  hypoth^^^is.     The  ANOVAs  presented  were 
performed  at  the  classroom  level,  weighted  by  number  of 
tested  children;  unweighted  classroom-level  and  child-level 
ANOVAs  replicated  the  results  and  are  not  presented  here. 
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Table  4.6 

VARIANCE  COMPONENTS   (VQ  ANALYSIS  OF  PPVT 
GENERALIZED  GAIN  SCOREg  

(Outlier  Center  Excluded) 


Three-Year  Olds 

ss             MS     .  VC           F  p 

2        761.37     380.68  29.20      8.80  .06 

Classrooms                3        129.74      43.25  (-)        .85  .47 

Children                  43      2188.61      50.90  50.90 

=  7.37          gi  =  9.36          93  =  11.31 


Four-Year  Olds 

SS  MS  VC  F  p 

'^^'^^"^  5        342.15       68.43  (-)         .69  .64 

Classrooms  a        ^93. 08      99.14        2.19      1.25  .28 

116      9182.63      79.16  79.16 

=  9.13  gi  =  9.48  93  a  22.81 

(-)   indicates  negative  estimate  for  VC. 


Children 
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In  Table  4.7,  where  all  centers  are  included,  there 
is  a  significant  (P«*03)  effect  for  staff-child  ratio  for 
three-year-olds  but  no  other  significant  effect.  Since 
previous  findings  indicated  that  a  small  center  effect  was 
introduced  by  an  outlier  center,  the  ANOVA  was  repeated 
omitting  that  center   (Table  4.8).    The  results  show  that 
without  center  C,  the  three-year-old  staff-child  ratio 
effect  remains  nearly  unchanged,  while  the  nonsignificant 
ratio  effect  for  four-year-olds  become  even  less  significant. 

Table  4.9  and  4.10  display  results  for  the  PPVT. 
There  are  no  significant  effects  when  all  centers  are  included. 
When  the  outlier  center  is  omitted,  however,  a  significant 
(p=.02)  staff/child  ratio  effect  emerges  for  four-year  olds. 
Slightly  more  statistically  powerful  analysis  across  age 
groups  that  exclude  the  outlier  center  (Table  4.11)  show  no 
significant  effects  for  the  design  variables  on  either  PSI 
or  PPVT  gain  scores.     Thus  there  are  hints  but  no  strong 
evidence  that  staff/child  ratio  affects  cognitive  gain 
scores. 

The  fact  that  the  variance  component  analysis 
showed  a  strong  classroom  effect  for  both  age  groups  on  the 
PSI  while  the  ANOVA 's  that  considered  the  two  design  factors 
showed  only  a  weak  staff-child  ratio  effect  for  three-year- 
olds  suggests  that  the  within-center  variance  is  attribut- 
able to  one  or  more  other  factors.    Possible  alternative 
factors  include  group  size,  teacher  variables  such  as 
previous  experience,  competence  or  general  personality,  and 
the  disruptive  effects  of  the  experiment.    Given  the  results 
of  subsequent  analyses  that  replicated  the  57-center  study, 
(N.  Goodrich,  1980b),  it  is  probable  that  a  major  source  of 
classroom  level  variance  for  the  PSI  is  group  size. 
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Table  4.7 
ANOVA  RESULTS  FOR  psi  (WEIGHTED} 


Three-Year  Olds 
SS  DP  MS 


2rWay/lnt,  6.70  2  3.35  .93 


Residual  39.72  11 


3.61 
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Main  Effects  45.92               3  15.31  3.90  .06 

"Rftif'''  '  27.46  7.00  .03 

Level  of  14.74               2  7.37  1  88  00 

Education  "  ^'^^  '22 


.25 


-^■-"'■y                         13.44                2    .            6.72  1.71 
Residual                  27.42              7  3.92 

Four-Year  Olds 

^              £1              M  F  sig. 

Main  Effects           24.12               3               8.04  2  22  1^ 

sta^^-chlid        5.33             1             I'll  I'M 


5.33  1.48  .25 
Ratio 

Level  of             16.89               2              8.44  2  33  1^ 

Education  2.33  .14 


.42 


.  Table  4.8 
ANOVA  RESULTS  FOR  PSI  (WEIGHTED) 


(Outlier  Center  Excluded) 


Three-Year  Olds 


SS 


DF 


MS 


Big. 


Wain  Effects  20.42 

Staff-Child  15.28 
Ratio 

Level  of  6.62 
Ed ucation 


3 

1 


6.81 
15.28 


3.94 
8.85 


3.31  1.92 


.09 
.03 

.24 


2-Way  Int. 


13.50 


6.75  3.91 


.09 


Residual 


8.63 


1.73 


Four-Year  Olds 


DF 


MS 


Si£. 


Wain  Effects  15.42 

Staff-Child  .32 
Ratio 

Level  of  14.96 
Education 


3  5.14        1.69  .24 

1  .32  .10  .76 

2  7.48        2.46  .14 


2-Way/Int. 


6.30 


3.15  1.03 


.40 


Residual 


27.41 


3.04 
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Table  4.9 
ANOVA  RESULTS  FOR  PPVT  (WEIGHTED) 


ERIC 


Three-Year  Olds 
SS  DP  MS 


-^"^^y  20.54  2  10.27  .50 


Residual  143.20  7 


20.46 


Four-Year  Olds 
SS  DF  MS 


Wain  Effects  44.15  3  14.72  1.50 


^"^^y  W.12  ,  2  7.06  ,72 

Residual  107.64  11  9.79 
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Sig. 


Main  Effects  31.18               3             10.39  .51  .69 

Staff-Child  1.16               1               1.16  06  Ri 

Ratio  '^^  '81 

Level  of  30.66               2             I5.33  7s  .;i 

Education  '^^ 


.63 


.27 


Staff-Child  17.57  1             17.57  1  79  91 

Ratio  -I'.a/  1./9  .21 

Level  of  25.58  2             12.79  1  n 

Education  ^  •^•■'•^ 


.51 


Table  4.10 
ANOVA  RESULTS  FOR  PSI  ACROSS  AGE  GROUPS 


(Outlier  Center  Excluded) 


Three^Year  Olds 

SS  DF  MS  P 

Main  Effects            60.16  3  20.05  1.63 

Staff-Child            .057  1  .057  .005 

Ratio 

Level  of              59.12  2  29.56  2.40 
Education 

2-Way/Int.               36.21  2  18.10  1.47 

Residual                  61.53  5  12.30 


Four-Year  Olds 

SS  DF  MS  F 

Main  Effects           64.23  3  21.41  3.59 

Staff-Child      44.39  1  44.39  7.44 
Ratio 

Level  of            18.99  2  9.50  1.59 
Ed ucation 

2- Way  Int.                22.63  2  11.32  1.90 

Residual                  53.68  9  5.97 
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Table  4.11 

AMOVA  RESULTS  ACROSS  AGE  GROUPS 
(Outlier  Center  Excluded) 


PSI  ss 


2-Wav/int.  7.30 


DF  MS  p 


Residual  72. 81  20 


3.64 


Siq. 


~  15.59              3              5.19  1.43  .26 

Staff-Child  9.43              1              9  43  5 

Ratio  ^'^^  2.59  .12 

Level  of  5.70               2               2  85  7fi  a-j 

Education  ^'^^ 


2  3.66        1.00  .39 


PPVT 


Main  Effects  49.36 

Staff-Child  21.46 
Ratio 

Level  of  25.20 
Education 


3 
1 


16.45 
21.46 

12.60 


1.35 
1.76 

1.03 


.29 
.20 

.37 


.2- Way  Int. 
■Residual 


15.52 
243.33 


2  7.76  .64 

9  12.17 


.54 
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Analyses  of  variance  based  on  the  experimental 
design  also  were  carried  out  using  the  Adult  Focus,  Child 
Focus  and  CDA  Checklist  data  as  dependent  variables. 
Although  there  were  scattered  significant  effects  for  one  or 
both  treatment  factors  on  these  variables,  there  was  no 
strong  evidence  that  either  factor  had  a  consistent  affect 
on  classroom  processes.    The  significant  results  are 
summarized  in  Table  4*12« 

For  53  observation  variables,  only  five  (10 
percent)   showed  significant  effects  (p<.05)   for  one  or  both 
factors  or  for  the  interaction.    When  the  outlier  center  was 
omitted,  the  pattern  of  effects  changed  slightly,  with  five 
effects  remaining  significant  and  an  additional  effect 
emerging.     There  was  no  strong  pattern  of  effects  within  any 
of  the  three  observation  measures;  the  most  consistent 
pattern  was  across  measures  and  suggested  that  either  level 
of  education  or  the  interaction  between  staff/child  ratio 
and  level  of  education  affects  aide  behavior  more  than  it 
affects  teacher  behavior,  skills  or  children's  behavior. 
This  finding  is  fairly  well  substantiated  In  the  replication 
analyses,  which  indicated  that  aides  were  more  affected  by 
the  policy  variables — especially  the  classroom  composition 
variables — than  were  teachers  or  children. 

Regression  Analyses 

In  the  analyses  of  variance  described  above, 
staff  child  ratio  is  categorized  as  a  two-level  variable. 
Observed  ratio  data  obtained  during  the  experimental  year 
suggested  that  although  ratio  contrasts  were  implemented, 
differences  were  not  as  great  as  expected.     The  observed 
data  also  indicated  that  staff  child  ratio  was  a  continuous 
variable  that  ranged  between  1 : 4  and  1:10.    To  incorporate 
this  considerable  variation  in  the  experimental  analysis, 
regressions  that  included  observed  staff/child  ratio  and 
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Table  4.12 


ERIC 


SUWARY  OF  ANOVA  RESULTS  FOR  AFI.  CFI 
AND  CPA  VARIABLES   


Variable 

All  Centers 
Aide  Instructs 
Aide  Management 
Aide  Social  Interaction 
Classroom  Management  (CDA) 
Child  Receives  Information 
(Tead)er-Directed  Activity) 

Qnittinq  Outlier  Center 

Aide  Instructs 

Aide  Management 

Aide  Social  Interaction 

Child  Receives  Information 
(Tfeacher-Directed  Activity) 


Source  of  Variation 


Eaucation  x  Staff/Child  Ratio 
Education 

Education  x  Staff/Child  Ratio 
Education  x  Staff/Child  Ratio 
Education 


Education  x  Staff/Child  Ratio 
Education 

-:)ducation  x  Staff/Child  Ratio 

1)  Education 

2)  Staff/Child  Ratio 


5.84 
4.66 
7.29 
4.52 
3.29 


4.09 

3.81 

4.18 

4.38 
4.89 


Sig. 

of  F 


.01 
.02 
.01 
.02 
.G5 


.04 

.05 

.04 

.03 
.04 
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level  of  education  were  computed.    To  provide  additional 
statistical  power,  these  analyses  were  combined  across  age 
groups  using  the  age-independent  change  score  measure.  The 
results  (Table  4.13)  confirm  the  ANOVA  results  and  show  that 
a  small  staff/child  ratio  effect  exists  for  the  PSI  only  if 
all  centers  are  included  in  the  analyses.    No  significant 
results  are  found  for  the  PPVT. 
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Table  4.13 


Dependent 
Veriable 

PSI  • 


PPVT 


PSI 


PPVT 


REGRESSION  RESULTS  FOR  APS  DESIGN  VARTAfi'  ZS 
WITH  CHILDREN'S  COGNITIVE  GAIN  SCORES  

(N«30) 


Independent 
Variable 


Staff/Child 
Ratio 

Staff/c>'ild 
Ratio 

Level  of 
Education 


Level  of 
Education 

Level  of 
Education 

Staff/Child 
Ratio 


Staff/Child 
Ratio 

Staff/Child 
Ratio 

Level  of 
Education 


Staff/Child 
Ratio 


Staff/Child 
Ratio 

Level  of 
Education 


B  SE^ 


•  36       28.76     13.92      4.27       .05  .13 

•  36  31.12  14.23  4.78  .02 
•08  .48         .55        .77  .47 


•25  1.08  .86  1.56 

-•14  -12.57  23.15  .30 

•23  15.01  12.87  1.36 

•23  16.13  13.33  1.46 

•04  .23  .52  .19 

-•29  -34.12  23.32  2.14 

-•29  -29.35  23.47  1.56 

•28  1.04  .87  1.41 


.23 
.74 

.25 

•  25 
.83 


.23 
.26 


.16 


.25        1.16         .84      1.92       .18  .06 


.07 


.05 


.06 


►15  ,08 


.14 
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CHAPTER  FIVE;     SUMMARY  AND  CONCLUSIONS 


A  classroom^level  factorial  design  that  crossed 
two  levels  of  staff/child  ratio  and  three  levels  of  staff 
education  was  implemented  in  eight  of  the  Atlanta  Public 
Schools  day  care  centers.    Although  observations  of  classroom 
structure  indicated  that  some  classes  did  not  maintain 
assigned  ratio  levels,  the  implemented  design  contained 
sufficient  contrasts  (1:5.5  vs.  1:7.5)   to  merit  further 
analysis.     The  primary  outcome  measures  used  were  PSI  and 
PPVT  gain  scores. 

Variance  component  analyses  based  on  a  twofold 
nested  design  of  classes  randomized  within  centers  indicated 
that  no  center  effect  existed  for  the  PSI,  but  that  a 
significant  classroom  level  effect  did  exist.    A  small 
center  effect  existed  for  the  PPVT  for  three-year  olds  only, 
but  since  there  was  no  classroom  effect  for  that  dependent 
measure  this  effect  should  not  invalidte  results  from  pooled 
analyses. 

Conventional  analyses  of  variance  and  regression 
analyses  that  considered  all  classes  (N=30)  showed  the 
presence  of  a  staff/child  ratio  effect  (p<.05)   for  PSI 
scores  of  three-year  olds.    The  effect  was  unchanged  when 
one  outlier  center  was  omitted  from  the  analyses.  In 
addition,  a  staff/child  ratio  affect  was  found  for  PPVT  gain 
scores  when  the  outlier  center  was  excluded.    Across  age 
groups,  there  were  no  significant  effects  for  the  design 
variables  in  either  the  ANOVAs  or  the  regression  analyses. 
When  the  outlier  center  was  omitted.     Thus  there  is  no 
consistent  staff/child  ratio  effect  on  cognitive  gain 
scores.     Scattered  significant  ratio  or  education  effects 
were  found  for  the  classroom  process  variables  but  the 
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pattern  of  relationships  was  not  strong.     There  was  no 
apparent  interaction  between  scaff/child  ratio  and  level  of 
staff  education  except  on  two  aide  behaviors.    No  other 
effects  of  either  factor  were  observed  for  the  process 
measures. 

The  APS  study  provides  evidence  that  higher 
staff/child  ratios  may  be  associated  with  higher  PSI  gain 
scores  for  three-year  olds  but  that  level  of  staff  education 
or  for  classroom  processes  has  little  predictive  value 
eitner  for  cogntive  changes  fPSI,  ppvT).     This  conclusion 
corroborates  independent  analyses  in  other  components  of  the 
NDCS,  which  show  no  consistently  strong  effect  for  either 
staff/child  ratio  or  the  two  education  variables  (years  of 
education,  highest  degree).    Given  the  large  classroom 
effect  in  tne  variance  components  analysis  and  the  small 
treatment  effect  in  the  ANOVA  and  regression  analysis  for 
the  PSI,  it  is  likely  that  a  non-experimentally  controlled 
classroom  effect  contributed  to  classroom-level  differences. 
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CHAPTER  ONE;  INTRODUCTION 


The  Atlanta  Public  Schools  (APS)  study,  under- 
taken as  part  of  the  National  Day  Care  Study  (NDCS) ,  was  a 
classroom-level  randomized  experiment  that  examined  two 
levels  of  staff/child  ratio  and  three  levels  of  staff 
education  using  a  factorial  design.    The  study  invoiced 
approxlmatley  260  tested  children  and  70  caregivers  in  eight 
of  the  APS  day  care  center.    An  account  of  the  APS  experiment 
and  its  conclusions  is  presented  by  N.  Goodrich  (1980). 
This  report  expands  the  study  of  the  APS  data  to  Include  a 
number  of  Independent  variables  which  were  not  experimentally 
manipulated,  but  which  varied  naturally  across  classrooms. 

The  APS  classroom-level  analyses  are  of  Interest 
for  several  reasons.     First,  the  APS  experiment,  which 
investigated  the  effects  of  staff/child  ratio  and  level  of  staff 
education  on  a  variety  of  child  outcome  measures,  found  that 
significant  differences  existed  between  classrooms  but^vthat 
effects  could  not  be  attributed  to  either  of  the  design  " 
factors.    Through  the  replication  analyses,  it  was  possible 
to  focus  on  alternative  explanations  for  these  classroom- 
to-classroom  variations.     Second,  because  APS  centers  serve 
primarily  black  children  of  low  socioeconomic  status  under  the 
same  auspices  and  funding  structures,  they  presented  an 
opportunity  to  examine  policy  variables  that  were  not 
confounded  with  these  major  background  variables.  Finally, 
Goodrich  and  Singer  (1980)  point  out  that  in  the  57-center 
study,  the  classroom  is  not  the  optimal  unit  of  analysis  for 
linking  pretest  and  posttest  scores  because  of  frequent 
classroom  reorganization,  especially  in  private  day  care 
centers.    APS  classrooms,  however,  were  relatively  stable 


q?nafr  ni^nf^  parallel  those  conducted  by  Goodrich  and 

n^tl^    ^  I^VlJ^°°^^'^':  ^^?^°^'  (1980)  and  Singer 

(1980).    All  APS  replication  analyses  were  performed  at  the 

lr!'lt,i°lV^''^^  ^""^  examined  only\hose  varlaSies  ?nc?Jde5 
in  the  APS  experimental  analysis  (see  N.  Goodrich,  1980). 
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and  permitted  the  construction  of  classroom-level  cognitive 
gain  scores.     Since  classroom-level  measures  of  classroom 
composition  and  caregiver  qualifications  may  provide  better 
information  concerning  a  child's  immediate  environment  than 
do  center-level  measures,  the  opportunity  to  perform 
classroom  level  analyses  appeared  very  useful. 


The  principal  variables  in  the  study  may  be 
classified  as  follows: 


•    Policy  Variables;     Caregiver  qualifications 

(PREVIOUS  DAY  CARE  EXPERIENCE,  CENTER  EXPERIENCE, 

LEVEL  OF  EDUCATION);  classroom  composition 
(STAFF/CHILD  RATIO,  GROUP  SIZE,  NUMBER  OF 

CAREGIVERS) . 


•    Process  Variables;     Adult-Focus  Instrument 
(AFI)  variables;  Child-Focus  Instrument  (CFI) 
variables;  Child  Development  Associates  (CDA) 
Checklist  variables. 


•    Child  Development  Tests;     Preschool  Inventory 
and  Peabody  Picture  Vocabulary  Test  generalized 
gain  scores  (PSI  GAIN  and  PPVT  GAIN). 


The  analyses  that  were  conducted  include: 


•    Effects  of  policy  variables  on  children's 

and  Peabody  Picture  Vocabulary  Test  gene  jized 
gain  scores   (PSI  GAIN  and  PPVT  GAIN). 


The  analyses  that  were  conducted  include: 


•  Effects  of  policy  variables  on  children's 
generalized  PSI  and  PPVT  gain  scores. 

•  Effects  of  policy  variables  on  classroom 
process  variables. 

•  Relationships  among  classroom  process  variat?.es. 

•  Effects  of  classroom  process  variables  on 
cognitive  gain  scores. 

•  Overall  relationships  among  policy,  process  and 
child  outcome  variables. 


The  major  concluaiona-which  in  large  part  replicate  those 
fron  the  other  studies  cited— are: 

•  Importance  of  Smaller  Groups s     Children  in 
smaller  groups  nad  Higher  PS I  gain  scores  and 
were  more  actively  involved  with  each  other 
and  with  caregivers.    Aides  interacted  more 
often  with  children  in  these  smaller-scaje 
environments . 

•  Caregiver  interactivenesB Caregivers  who 
interacted  more  often  with  children  were  fouPa 
iHvoiJed^"  where  children  were  more  actively 

•  Differences  between  Teachers  and  Aides i  Aides 
appeared  to  be  more  strongly  influenced  by 
variations  in  classroom  composition  than  rlid 
teachers . 

•  ^f^g^Jf'^  Q^'^lif^^ations;    Caregivers  wi.h  .-.ore 
^evious  day  care  experience  received  higr^r 
OTA  Checklist  ratings.    Moreover,  classes  in 
vftiich  there  were  more  experienced  caregiveT-o 

"O'^^  *=tive  participation 
iqr  children  in  classroom  activities,  more 

PPVT"giiSs?°  f'^o"  adults  and  higher 

In  general  these  findings  replicate  those  of  the  various 
three^site  studies,     it  wss  not  possible  to  determine  the 
effect  Of  previous  day  c«e  experience  in  the  overall  ^.wdy 
because  of  the  limited  variation  in  that  variable.  <t, 
addition  the  APS  finding  that  aides  were  more  influc.-.ed 
than  teachers  by  classroom  composition  was  not  replicated 
in  the  larger  study—a  result  that  probably  is  due  %o  the 
unique  role  that  aides  played  in  the  APS  experiment. 

The  remainder  of  this  report  is  organized  into  five 
chapters,     m  Chapter  Two,  the  variables  included  in  the  APS 
analyses  and  the  methodology  employed  are  described.  The 
effects  of  the  policy  variables  on  both  classroom  process 
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variables  and  children's  generalized  cognitive  gain  scores 
are  presented  in  Chapter  Three.     Relationships  among 
process  variables  are  discussed  in  Chapter  Four,  and  the 
effects  of  process  variables  on  cognitive  gain  scores  are 
presented  in  Chapter  Five.     Finally,  in  Chapter  Six  the 
major  results  of  the  APS  study  are  summarized*  Most 
of  the  tables  mentioned  in  the  text  appear  in  Appendix  A. 
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CHAPTER  TWO;     VARIABLES  AND  METHODOLOGY 


Variable  Selection 

The  major  variables  included  in  the  APS  analyses 
are  presented  in  Figure  2.1.     These  variables  were  derived 
from  a  common  NDCS  data  base  used  in  both  the  APS  and  the 
three-site  studies.     However,  to  take  advantage  of  special 
characteristics  of  the  APS  sample  and  of  the  experimental 
design  that  was  implemented,  there  were  certain  differences 
in  variable  selection  and  construction. 

First,  for  most  analyses  the  design  variable  LEVEL 
OF  EDUCATION  was  used  instead  of  YEARS  OF  EDUCATION,  HIGHEST 
DEGREE  or  SPECIALIZATION.     LEVEL  OF  EDUCATION  was  created  to 
capture  unique  educational  contrasts  that  existed  only  in 
the  APS  centers;  consequently,  it  is  a  more  specifically 
defined  measure  than  are  its  counterparts  in  the  overall 
study.    A  second  difference  is  that  averaged  measures  of 
GROUP  SIZE,  STAFF/CHILD  RATIO,  previous  experience,  and 
center  experience  did  not  include  the  September  (baseline).. 
data.    This  computation  was  revised  for  the  APS  sample 
because  the  experimental  changes  required  for  the  study  were 
not  effected  until  October  1976,  following  the  first  wave  of 
classroom  composition  observations.     Finally,  in  the  APS 
study,  classroom  process  analyses  focused  on  variables  that 
indicated  what  caregivers  did  and  how  children  responded, 
in  the  three-site  study,  process  analyses  were  supplemented 
by  information  relating  to  more  structural  processes  (such 
as  to  whom  caregivers  directed  their  attention).     Thus  the 
APS  analyses  include  some  variables  not  reported  for  the 
various  three-site  analyses  and  omit  others. 

Measures  of  classroom  composition  (GROUP  SIZE, 
STAFF/CHILD  RATIO,  NUMBER  OF  CAREGIVERS)  were  available  f 
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Figure  2.1 

mm  VARIABLES  USED  IN  APS  ANALYSES 
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three  sources:    observation  data  averaged  from  several  time 
points;  counts  made  during  adult-focus  observations  (April- 
May  1977);  and  counts  made  during  child-focus  observations 
(April-May  1977).     Relationships  among  data  from  these  three 
sources  have  been  examined  for  both  the  APS  and  the  larger 
studies  (Bache,  1980).     Because  low  correlations  were  found 
between  the  adult-focus  counts  and  the  other  measures,*  and 
because  caregivers'  behaviors  are  likely  to  be  influenced  by 
the  classroom  organization  at  the  time  of  the  observation, 
the  adult-focus  counts  were  used  in  both  the  AFl  and  the  CDA 
analyses,  the  averaged  observation  data  were  used  in  the 
remaining  analyses. 

The  data  measuring  classroom  processes  (API,  CFI 
CDA)  and  children's  cognitive  development  (PSI,  PPVT)  were' 
collected  in  October  1976  {T3)  at,d  Hay  1977  {T4)  by  observers 
and  testers  from  International.     Information  about  the 
policy  variables  was  collected  on  an  on-going  basis  by 
center  secretaries  provided  by  Abt  Associates.     Abfs  staff 
were  responsible  for  defining,  editing,  and  analyzing  all  of 
the  variables  reported  in  this  paper. 


Methodol 


23:^ 


Relationships  among  policy,  process  and  outcome 
variables  were  investigated  primarily  through  use  of  multiple 
regression  techniques.     Correlations  wer^  also  computed  for 
preliminary  investigations  of  relationships  among  variables 
In  addition,  for  the  process-outcome  analysis,  partial 
correlations  were  employed  to  adjust  for  effects  of  relevant 
policy  variables. 


^"^  =°""ts  were  slightly  lower 

ferenJ'cr?Jeri'a°mfv7"''°[!  -"^gesti^g "LJ  Jlf- 
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The  focus  of  the  regression  analyses  was  to 
develop  a  simple  predictive  model  without  in;:.roducing  severe 
multicollinearity .     Forward  stepwise  regrear?AOT>  using  the 
algorithm  in  the  SPSS  software  package  was  the  principal 
investigative  tool.     Regressions  to  predict  cognitive  gain 
scores  were  weighted  by  the  number  of  tested  children  in  the 
classroom • 

As  variables  were  entered  into  the  regression 

model,  changes  both  in  the  regression  coefficients  (B's)  and 

2 

the  percent  of  variance  accounted  for  (R  )  were  examined. 
In  addition,  the  significance  of  the  model  was  tested  using 
the  F-ratio.     Multicollinearity  was  presumed  to  be  present 
if  any  of  the  B  coefficients  fluctuated  by  more  than  one 
standard  deviation  when  a  new  variable  was  introduced. 
Further,  each  individual  variable  was  required  to  be  signi- 
ficant at  approximately  the  .05  level.     For  some  borderline 
cases,  the  decision  to  include  or  exclude  a  variable  was 
based  on  intuition  and/or  the  extent  to  which  the  resulting 
model  paralleled  models  for  other  dependent  variabl«^s.  The 

models  that  emerge  do  not  always  achieve  the  highest  possible 
2 

R     (given  the  estimated  reliabilities  of  the  measures) , 
but  regression  coefficients  of  the  models  are  readily 
i nterpretable  as  "effects"   (although  causal  inferences 
cannot  be  made  from  associational  data) . 
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CHAPTER  THRRR;     ANALYSES  OF  THE  POLICY  VAPTARfPg 


Iff'l'^^^^^  variables  an.  c».n.M.. 

Generalized  gain  scores  for  two  cognitive  tests— 
the  Preschool  Inventory  (PSI)  and  the  Peabody  Picture 
vocabulary  Test  (PPVT)-were  used  in  ths  APS  analyses. 
Although  data  were  available  for  a  gross  motor  scale  based 
on  the  Denver  Developmental  Screening  Test  and  for  the  Pupil 
Observation  Checklist  (POCL) ,  psychometric  analyses  (Bache, 
1980)  indicated  that  these  change  scores  were  not  sufficiently 
reliable  to  be  analyzed.  The  generalized  gain  scores  used 
in  the  APS  study  are  Identical  to  those  used  in  the  57-center 
cognitive  effects  analyses  (Goodrich  and  Singer,  1980).  The 
algebraic  formulas  used  to  compute  gain  scores  are: 


and 


PSI  GAIN    =  T4PSI  -  (.88  X  T3PSI) 
PPVT  GAIN  -  T4PPVT  -  (.88  X  T3PPVT) . 
Unit  of  Analyslg 

Two  units  of  analysis— child  and  classroom— were 
considered  initially.    Class-level  regressions  and  corre- 
lations were  weighted  by  the  number  of  fces^tcd  children  per 
class.    When  independent  variables  are  denned  only  at  class 
level,  child-level  and  weighted  class-level  regression 
coefficients  are  mathematically  identical  (see  Goodrich  and 
Singer,  1980).    However,  hypothesis  testing  is  different  in 
the  two  cases  and  is  not  valid  at  child  level  if  (as  is 
usually  true)  the  residuals  are  correlated  within-class. 
Regressions  run  at  class  and  child  level  (Tables  A.l  and 
A.2,  Appendix  A)  provided  empirical  verification  of  these 
theoretical  results.    Regression  analyses  were  therefore 
conducted  at  the  classroom  level. 
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Construction  of  Measures  of  Group  Size  and  Staff/ 


Child  Ratio 


In  a  second  analysis,  the  appropriate  construction 
of  group  size  and  staff/child  ratio  measures  was  investigated 
(see  also  Bache,  1980).     Regression  models  were  developed 
for  both  the  untransf ormed  classroom  composition  variables 
and  for  the  logarithms  of  these  variables,  using  generalized 
gain  scores  as  dependent  measures.     The  results  (Tables  A.3 
and  A«4,  Appendix  A)  showed  that  the  unlogged  classroom 
composition  variables  were  slightly  stronger  predictors  than 
were  their  logged  counterparts.     Consequently,  basic  regres- 
sion models  were  developed  for  the  untransf ormed  measures. 

Correlation  Analyses 

Correlations  of  the  policy  variables  with  each 
other  and  with  PSI  and  PPVT  gain  scores  were  computed  at 
the  classroom  level  weighting  by  the  number  of  children 
tested   (Tables  3.1  and  3.2).  GROUP  SIZE  and  STAFF/CHILD 
RATIO  were  both  significantly  correlated  (p<.05)  with  PSI 
GAIN;  PREVIOUS  DAY  CARE  EXPERIENCE  was  the  only  policy 
variable  significantly  correlated  with  PPVT  GAIN.  NUMBER 
OF  CAREGIVERS  was  highly  correlated  with  both  GROUP  SIZE 
and  STAFF/CHILD  RATIO;  however,  STAFF/CHILD  RATIO  and  GROUP 
SIZE  were  relatively  independent  (r=.17,  p>.15).  Both 
PREVIOUS  DAY  CARE  EXPERIENCE  and  CENTER  EXPERIENCE  were 
correlated  with  GROUP  SIZE,  creating  potential  problems  in 
interpretation. 

Regression  Analyses 

To  investigate  the  relationship  between  policy 
variables  and  generalized  gain  scores,  regression  equations 
were  estim^.ted  using  all  possible  combinations  (one  to  six 
variables)  of  the  following  policy  variables: 
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ftble  3.1 


Vwrs  of  Mucatlon   '  "^^^^   ^P^^^'^Mtlon    of  taucatlon 


Staff/OiUd  Ratio     .21**  .n* 


Group  Size  .,35** 


1 


••10*        -.16**  I 


/^nterEKp.  .^^^^        ^^^^     ^  CHIIDliVEL 

Prev.  toy  Care  B(p.  .^26**  ""^es 

Specialization  .08 
l<vel  of  Education  .go** 
Nunber  of  Caregivers  -.10*  -.lo* 


.23** 

.12* 


1 

.26** 

.12* 

1 

.26** 

'  .08 

.09 

.18** 

-.38** 

1 


1 


4^8 


Years  of  Education 
Staff/Ojlld  Ratio  .36* 
Group  Size  ..52** 
Center  Bip. 

n  '28  1 

Prev.  Day  Care  Exp.  .^26       -33*  Wmht 

Specialization  '        ^        ^  CUSS  LEVEL 

I*vel  of  Education  .50**  *  ^  N=30 

N«^r  of  caregivers  ^^g,,  ^g^.. 

•p<.05 
**P<.01 

Correlations  are  reprted  only  for  p<.l5. 


Table  3.2 

PEMSONfmiATiaSFORroLiaVMlIABUW 


Independent 
Variable 

pwr 

Years  of 

Education 

Staff/Child 
Ratio 

Group 
Size 

Center 
Exp. 

Previous  Day 
Care  Exp. 

years  o(  Education 

1 

Staff/Child  Ratio 

M 

1 

Group  Size 

-.09 

-.13* 

-.15* 

1 

Center  Exp. 

-.12* 

.31** 

1 

Prev.  Day  Care  Exp, 

-.21** 

-.26** 

-.32** 

1 

Speclallution 

.11  . 

-.25** 

.25** 

.16* 

Level  of  Education 

.60** 

-.13* 

-.10 

.26** 

Nunber  of  Caregivers 

-.12* 

.50** 

.69** 

.19** 

-.39** 

years  of  Education 

1 

Staft/Chlld  Ratio 

I 

Group  Size 

-.23 

1  . 

Center  &(p. 

.31* 

1 

Prev.  Day  Care  Exp. 

-.51** 

••26 

-.33* 

1 

Specialization 

.26 

-.25 

.25 

Level  of  Education 

.25 

.50** 

-.19 

Ntnber  of  Caregivers 

.«** 

.68** 

-.19 

-.?1* 

Level 

Speclalliatlon   of  Education 


*p<.05 

Oorrelatlons  are  reported  only  for  p(el5e 


CHIID  LEVEL 
MS9 


1 

.11  1 
-.10 


WEIGHTED  M 
CUSS  LEVEL 
N"30 
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•  GROUP  SIZE; 

•  STAFF/CHILD  RATIO; 

•  YEARS  OF  EDUCATION; 

•  SPECIALIZATION; 

•  CENTER  EXPERIENCE; 

«?  PREVIOUS  DAY  CARE  EXPERIENCE;  and 

«  LEVEL  OF  EDUCATION 

Another  policy  variable— NUMBER  OF  CAREGIVERS— also  was 
considered  in  preliminary  regressions.    This  variable, 
however,  was  not  as  ^ood  a  predictor  as  either  GROUP  SIZE  or 
STAFF/CHILD  RATIO,  and  because  any  two  of  these  three 
variables  specify  the  third  variable  (i.e.,  STAFF/CHILD 
RATIO  =  GROUP  SIZE/NUMBER  OF  CAREGIVERS),  all  three  could 
not  be  entered  simultaneously.*    The  investigation  was 
therefore  pursued  using  only  STAFF/CHILD  RATIO  and  GROUP 
SIZE. 


Two  different  regression  models  emerged  from  these 
analyses  (see  Tables  A.l  and  A.2,  Appendix  A).    For  the  PSl, 
the  model  included  the  combination  of  GROUP  SIZE,  STAFF/CHILD 
RATIO  and  SPECIALIZATION  (r2  =  .51)   whereas  the  PPVT  model 
utilized  only  PREVIOUS  DAY  CARE  EXPERIENCE   (R^  =  .26). 
Adding  LEVEL  OF  EDUCATION  and  CENTER  EXPERIENCE  to  the  PPVT 
model  increased  the  R^  to  .34.    However,  these  variables 
were  not  included  in  the  model  because  neither  was  a  signi- 
ficant predictor  either  alone  or  with  PREVIOUS  DAY  CARE 
EXPERIENCE. 

To  determine  whether  major  regression  results 
could  be  attributed  to  outlier  classrooms,  robust  (bi- 


!^  measures  were  included,  there  would  be  a 
linear  combination  among  the  independent  variables;  with 
such  a  linear  combination,  it  would  be  impossible  to 
""^timate  regression  models. 


447 


470 


weighted)  regressions  also  were  performed.     The  biwelghted 
regression  Iteratlvely, down-weights  the  influence  of  classes 
that  are  further  from  an  ordinary  least  squares  regression 
surface.    Although  several  outlier  classes  were  identified^ 
omitting  these  classes  from  the  analysis  did  not  signifi- 
cantly change  the  regression  resi'lts.     Classroom  composition 
measures,  especially  GROUP  SIZE,  remained  significont 
predictors  of  PSI  GAIN,  and  PREVIOUS  DAY  CARE  EXPERIENCE 
remained  a  significant  predictor  of  PPVT  GAIN. 

Both  the  correlation  and  regression  results 
indicate  that  children's  PSI  and  PPVT  gain  scores  are 
associated  with  different  policy  variables.     GROUP  SIZE  is 
strongly  associated  with  PSI  GAIN  but  not  with  PPVT  GAIN. 
On  the  other  hand,  PREVIOUS  DAY  CARE  EXPERIENCE  is  positively 
and  significantly  related  to  PPVT  GAIN  but  not  to  PSI  GAIN. 
It  is  perhaps  not  surprising  that  two  distinct  regression 
models  emerged  for  predicting  PSI  and  PPVT  gain  scores. 
Although  PSI  and  PPVT  scores  are  highly  co'-reloted  in  the 
APS  sample  (rip3  =  .62;  r^^  =  .59),     tljeir  gain  scores  are 
not  significantly  correlated  (r^i^T^jj^  =  .06).     Thus,  there 
is  evidence  that  the  two  tests  measure  different  aspects  of 
children's  cognitive  development. 

Covariables  and  Cognitive  Guin  Scores 

The  rffects  of  nine  child-specific  covariables  on 
PSI  and  PPVT  generalized  gain  scores  also  were  investigated 
in  the  APS  analyses.     These  covariables  were: 

•  NUf^BER  OF  ADULTS   (in  the  household); 

•  NUMBER  OF  SIBLINGS; 

•  NUMBER  OF  SIBLINGS  UNDER  12  YEARS; 

•  AGE  OF  CLOSEST  SIBLING; 
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•  FAMILY  INCOME   (categorical  variable); 

•  MOTHER'S  EDUCATION; 

•  AGE; 

•  RACE;  and 

•  SEX.  4 

The  influence  of  these  covariables  on  children's  cognitive 
development  was  examined  at  .oth  child  and  classroo^  leve  s 
At  the  Child  level,  covariables  and  fall  test  scores  were 
use    to  predict  spring  test  scores.    The  results  (Table  .  3 
indicate  that  for  both  the  PSI  and  the  PPVT  the  fall  te.- 

weTan^  I  ''''''''''  °'  ^^^^"^ 

were  any  of  the  covariables.    Although  several  of  the  covar-' 

AD  L™  ZT'^'""'  Significant  predictors  (NU«BER  oP  ' 
ADULTS  and  AGE  for  the  PSI  score;  AGE  and  SEX  for  the  PPVT 
score  ,  their  overall  significance  at  the  child  level  waT 
no t  of  p.  ^^^^         covariables  aL  the 

policy  variables  were  entered  into  regressions  predicti  g 
.enera  ieed  gain  scores  at  the  cl.ld  level,  .u«BER  oTlZ..S 
was  a  barely  significant  predictor  of  PSI  GAIN  (p<.o.,.  ' 
there  were  no  significant  predictors  for  PPVT  GAIN. 

Covariables  also  were  used  to  prelict  age- 
adjusted  gain  scores  at  the  classroom  level.    T^ese  aggre- 
gated variables  thus  became  measures  of  the  learni.,  Zir- 
onment  rather  than  of  an  individual  child,     it  is  rot 
surprising,  therefore,  that  different  regression  results 
were  obtained  at  the  classroom  level  fTe- :   3.4)      AGE  op 
CLOSEST  SIBLING  was  a  significant  oredi      '  / 
MOTHER'S  EDUCATION  was  a  sioLfi  a  .  'T 
Th-  slnnif^  V         =ig"i"«nt  pre-:i  ..or  of  r-^VT  GAIN. 

Th.  Significance  .f  these  covariables  w. probably  due  to 
t.^e  fact  that  they  were  highly  correlated  with  the  policy 
variables  included  in  the  regression  models  for  predlcUng 
gain  scores  (for  GROUP  SIZE/AGE  OF  CLOSET  SIBLING  r=  -  .fl! 
for  STAFF/CHILD  RATIO/AGE  OF  CLOSEST  SIBLIKG  r=  32-  for 
PREVIOUS  DAV  CARE  EXPERIENCE/MOTHER'S  EDUCATION *r=: 3 6^ 

449 


Table  3.3 


COVARIABLE  REGRESSION  RESULTS: 

CHILD  LEVEL 

Dependent 
Variable 

Independent 
va  riaoie 

o 

F 

^ring  PSI 

Fall  PSI 

.77 

.05 

199.93** 

'.45 

Fall  PSI 

Nunber  of  Mults 

.78 
1.19 

.05 
.40 

210.08** 
8.70** 

.46 

F^ll  PSI 

Nunber  of  Adults 
Age 

.71 
1.15 
1.29 

.06 
.40 
.57 

132.32** 
8.31** 
5.14** 

.48 

Spring  PPVT 

F^ll  PPVT 

.76 

•  05 

Eall  PPVT 
Age 

.68 

3.32 

.0*1 
1.16 

119.98** 
8.12** 

.45 

Fall  PPVT 
Sex 

.67 
3.55 
1.83 

.06 
1.17 
1.06 

119.98** 
9.23** 
3.01* 

.45 

PSI  Gain  Score 

Number  of  Adults 

.91 

.43 

4.38-^* 

.02 

Number  of  Adults 
Age  of  Next  Sibling 

.95 
.11 

.43 
.07 

4.88* 
2.57 

PPVT  Gain  Score 

Nunber  of  Adults 

.89 

.91 

.94 

,004 

*p<.05 
♦*p<.01 


4  -1 
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Table  3.4 


Dependent 
Variable 


COVARIABLE  REGRESSION  RESULTS;    CLASSROOM  LEVEL 


Independent 
Variable 


PBl  Gain  Score        Age  of  Next  Sibling  .53 

Age  of  Next  Sibling 
Number  of  Adults 


PPVT  Gain  Score 


Group  Size 
Staff/Child  Ratio 
Center  Experience 
Previous  Day  Qire 
Experience 
Nunber  of  Adults 


Mother's  Education  6.87 

Mother's  Educati 
Nunber  of 


Previous  Day  Gire 
Experience 


Previous  Day  Care 
Experience 


B 

!^ 

F 

I  .53 

.22 

5.75* 

.17 

I  .52 

.21 

6.05* 

.26 

1.  Jl 

3.18 

.35 

.08 

.Do 

15.17 

11.69 

1.68 

.48 

.26 

3.34* 

-.75 

.48 

2.48 

1.24 

1.18 

1.11 

6.87 

2.10 

10.72** 

.28 

7.27 

2.11 

11.81** 

.31 

1.43 

1.24 

1.32 

2.31 

.74 

9.72** 

.26 

5.12 

2.11 

5.87** 

1.65 

.73 

5.02* 

*p<.05 
**p<.01 
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When  the  covarlables  were  entered  into  regressions  with  the 
policy  variables,  the  overall  results  did  not  change.  The 
stepwise  regression  procedure  did  not  select  any  covariabl&s 
for  the  PSI  model,  and  although  MOTHER'S  EDUCATION  was  a 
better  predictor  of  PPVT  GAIN  than  was  PREVIOUS  DAY  CARE 
EXPERIENCE,  the  experience  variable  still  remained  signifi- 
cant after  mother's  education  was  considered.  Thus, 
the  major  results  do  not  appear  to  be  threatened  by  covari- 
able  effects. 

Conclusions 

The  APS  results  indicate  that  children's  PSI  gain 
scores  are  positively  associated  with  small-scale  class 
composition,  especially  small  group  sizes,  and  that  PPVT 
gain  scores  are  more  related  to  caregiver  backgrounds. 
In  particular,  PPVT  results  suggest  that  caregivers  with 
more  previous  day  care  experience  are  found  in  those 
classes  where  there  is  greater  improvement  in  children's 
vocabulary  skills  as  measured  by  the  PPVT.*    Several  back- 
ground variables   (AGE  OF  CLOSEST  SIBLING,  MOTHER'S  EDUCATION, 
PREVIOUS  DAY  CARE  EXPERIENCE)  are  also  predictive  of  cognitive 
gains.     However,  the  principal  conclusions  remain  stable 
when  the  e  covariables  are  controlled  for  in  regression 
models. 


*It  should  be  noted  that  PSI  results  tend  to  indicate  that 
even  though  the  two  experience  variables  are  not  signifi- 
cant predictors  of  PSI  gains,  less  previous  day  care 
experience  and  more  center  experience  are  related  to  higher 
gain  scores.     This  finding  does  not  appear  to  be  a  result 
of  outlier  values  for  either  of  the  two  independent  vari- 
ables; in  addition,  the  unweighted  distribution  of 
variables  is  similar  for  both  gain  scores.     Thus  it  seems 
probable  that  the  anomalous  relationship  is  due  more  to 
inadvertent  confounding  of  the  experience  variables  with 
GROUP  SIZE  than  to  differences  in  cognitive  gains  as 
measured  by  the  PSI  and  the  PPVT. 


Relationships  between  Policy  variables  and  Classroom  Process 
Adult-Focus  Observations 

Data  obtained  from  the  Adult-Focus  Instrument 
(API)  describe  caregiver  activity  In  the  classroom  using 
■sentences-  Identifying  an  actor  (who) ,  the  object  of  the 
action  (to  whom) ,  the  nature  of  the  action  (what) ,  and  the 
style  of  the  action  (how).    For  analytic  purposes,  the 
Information  In  these  sentences  was  reduced  to  the  percentage 
of  observed  time  that  the  focal  caregiver  was  Involved  In 
each  activity  type  (Goodson,  1980).     The  Adult  Focus  instru- 
ment Includes  a  Physical  Environment  Inventory,  which 
describes  space,  materials  and  equipment  in  the  classroom;  a 
Classroom  Snapshot,  which  describes  general  activity  patterns 
at  a  point  in  time;  and  a  Five-Minute  Interaction  record, 
which  describes  the  behavior  of  a  particular  caregiver  in 
detail.    The  Five-Minute  Interaction  data  are  of  primary 
interest  here. 

Because  of  the  unique  educational  comparisons 
created  in  the  APS  study  design,  the  analyses  focused 
primarily  on  a  selected  set  of  -what-  codes  to  investigate 
differences  in  caregiver  activities  that  might  exist  for 
different  levels  of  education  and  job  roles.     Factor  analyses, 
correlations  and  conceptual  considerations  were  used  to 
determine  a  set  of  six  variables  for  the  investigation: 

•  INSTRUCTS; 

•  ADULT  ACTIVITY; 

•  CENTER  ACTIVITY; 

•  OBSERVES; 

•  MANAGEMENT  BEHAVIOR   (defined  as  COMMANDS. 
CORRECTS) ;  and 

•  !°oi«^„^^'^^'^^'^^°^  (defined  as  Direct  QUESTIONS, 
RESPONDS,  INSTRUCTS,  COMFORTS,  PRAISES). 
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The  MANAGEMENT  BEHAVIOR  and  SOCIAL  INTERACTION  constructs 
were  defined  as  in  the  57-center  adult»focus  analyses 
(Goodson,  1980).     APS  factor  analyses  suggested,  however, 
that  INSTRUCTS  was  less  related  to  social  interaction  than 
were  the  other  codes  included  in  this  construct  (DIRECT 
QUESTIONS,  RESPONSES,  COMFORTS,  PRAISES).     The  APS  analysis 
therefore  also  examined  INSTRUCTS  independently. 

Values  for  classroom  composition  variables  used  in 
adult-focus  analyses  were  derived  from  the  Classroom  Snapshot 
immediately  preceding  the  Five-Minute  Interaction.  GROUP 
SIZE,  NUMBER  OF  CAREGIVERS  and  STAFF/CHILD  RATIO  were 
computed  by  averaging  staff  and  child  counts  taken  before 
each  five-minute  observation.     PREVIOUS  DAY  CARE  EXPERIENCE, 
CENTER  EXPERIENCE  and  LEVEL  OF  EDUCATION  data  are  for  the 
focus  caregiver.     Teacher-  and  aide-focus  data  were  examined 
separately  in  all  analyses.    Aide-focus  observations  were 
available  for  only  22  of  the  23  classes  with  aides;  teacher- 
focus  observations  were  available  for  all  30  lead  teachers. 

Regression  models  were  developed  using  policy 
variables  as  predictors  for  each  of  the  six  adult'-focus 
constructs.     The  results  are  shown  in  Table  3.5.  For 
teachers,  the  regressions  for  the  adult-focus  variables 
suggest  that  a  level»of-educa tion  effect  exists  for  both 
CENTER  ACTIVITY  and  OBSERVES.     Since  all  teachers  with  a 
high  level  of  education  (M.A.)  also  served  as  center 
directors,  it  seems  probable  that  the  education  effect  was 
due  more  to  job  requirements  than  to  education.  To 
investigate  this  rival  hypothesis,  regressions  were 
re-estimated  excluding  center  directors;  as  expected,  the 
level  of  education  effect  disappeared.     Without  the  directors, 
the  only  adult-focus  variable  that  was  significantly  predicted 
by  any  of  the  policy  variables  was  CENTER  ACTIVITY,  for 
which  a  combination  of  STAFF/CHILD  RATIO  and  TOTAL  DAY 
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Tsble  3.5 


Ul 


Instructs 
Mult  Activity 
Center  tetlvlty 

Observes 


Management 
Behavior 


All  Teachers 
Predictor  sign 


U.  level 
Ratio* 

Dd.  Level 
Group  Size 


Social  Interaction 


1+) 
(+) 

I-) 
I-) 


.17 

.25 

.17 
.26 


W,  HS 
Teachers 
Predictor  sign 


S/C  Rstio*  (+) 
Cfenter  top.  (+) 
Prev.  D.C.  &p.  (+) 


.23 
.41 


'1 


A) 


B) 


Aides 

ftedlctoj:  sign 
Group  Size**  (.) 
S/C  tatio*  (-) 


D-C.  Q(p.*  (.) 

Group  Size:  (-) 

5/Q  Ratio*  (.) 

O.C.  B(p.*  (_) 

W.  Level*  (+) 

I  Caregivers**  (-) 

Group  Size*  (-) 

Center  Exp.*  (-) 

S/C  Ratio*  (-) 


.2 


R_ 
.32 
.22 


Group  Size**  (+) 


.25 
.41 
.50 

.25 
.36 
.48 

.23 
.38 
.57 


Croup  Size**   (-)  .57 
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CARE  EXPERIENCE  (CENTER  EXPERIENCE  plus  PREVIOUS  DAY  CARE 
EXPERIENCE)*  accounted  for  41  percent  of  the  variance. 


The  classroom  composition  variables  were  much 


stronger  predictors  of  aide  behavior  than  of  teacher  behavior, 
GROUP  SIZE  was  the  only  significant  (p<.01)   predictor  of 
three  of  the  variables — INSTRUCTS,  OBSERVES  and  SOCIAL 
INTERACTION — and  was  the  best  single  predictor  of  MANAGE- 
MENT BEHAVIOR.     STAFF/CHILD  RATIO  was  the  only  significant 
(p<.05)  predictor  of  ADULT  ACTIVITY  and,  together  with 
CENTER  EXPERIENCE  and  GROUP  SIZE,  was  significant  in  pre- 
dicting MANAGEMENT  BEHAVIOR.     Thus,  there  is  evidence  that 
aides  dn  the  APS  study  were  especially  affected  by  classroom 
composition.    Aides  tended  to  be  more  active  in  smaller 
classes  with  higher  ratios.    As  classes  became  larger  and 
ratios  decreased,  aides  became  passive  and  tended  to  observe 
more  often  or  to  engage  in  adult-related  activity.  Although 
the  classroom  composition  variables  were  not  significant 
predictors  of  teacher  activities,  in  general  the  same 
pattern  of  behavior  was  observed:     teachers  were  more  active 
in  smaller-scale  environments.     (Details  of  the  regression 
analyses  are  shown  in  Tables  A. 5  and  A. 6,  Appendix  A). 

For  all  adult-focus  constructs  except  aides' 
MANAGEMENT  BEHAVIOR,  there  was  at  most  one  plaufi;ible  pre- 
dictive model.     It  is  evident  that  the  model  toe  MANAGEMENT 
BEHAVIOR  for  aides  should  include  some  combination  of  the 
composition  variables  and  CENTER  EXPERIENCE   (or  TOTAL  DAY 
CARE  EXPERIENCE);   the  best  model  may  also  ir.ilude  LEVEL  OF 
EDUCATION.     Although  a  single  model  cannot  be  identified  due 
to  the  similar  regression  results  for  several  independent 
variables,  it  is  clear  that  aides"  management  behavior  is 


*These  two  variables  are  correlated  -.47  in  the  sample. 
Because  of  the  mul ticollineari ty ,  they  cannot  be  separated 
in  this  particular  regression. 
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affected  by  both  classroom  composition  and  caregiver  quali- 
fications, moreover,  it  is  the  only  aide-focus  variable  for 
which  caregiver  background  information  is  a  significant 
predictor. 

Overall,  the  regression  analyses  gave  little 
indication  that  caregiver  behaviors  are  associated  with 
the  caregiver's  level  of  education.     However,  the  relatively 
small  sai^ple  size  (N»30  for  teachers,'  N=22  for  aides)  may 
not  have  provided  sufficient  power  to  detect  small  differ- 
ences that  might  exist,     since  the  APS  design  presented  a 
unique  opportunity  to  study  the  interaction  between  the 
level  of  education  and  job  roles  (teacher  or  aide)  of 
caregivers,  the  adult-focus  data  were  examined  extensively 
for  interesting  patterns  of^  behavior  by  education  within 
job.    Analyses  included  graphic  techniques  such  as  stem- 
and-leaf  displays  and  schematic  plots,  t-tests  for  differ- 
ences in  means,  and  correlations  by  level  of  education  and 
job  role. 

The  results,  which  are  shown  in  Tables  A.7  toA.ll 
in  Appendix  A,  show  that  although  there  was  some  indication 
that  caregivers  with  more  education  were  more  involved  in 
classroom  activities,  the  evidence  did  not  support  a  level 
of  education  effect.     The  most  consistent  pattern  to  emerge 
was  that  caregivers  whose  job  roles  were  changed  for  the 
experimental  year  were  less  vulnerable  to  the  effects  of 
a  large-scale  classroom  environment.    This  may  be  a  genuine 
result  of  a  change  in  routine,  or  it  may  be  an  indication  ' 
that  the  experimental  situation  affected  caregiver  behaviors 
(Hawthorne  effect) . 

Child-Focus  Ohservations 

Child-Focus  Instrument  (CFI)  observations  were 
obtained  for  target  children  in  all  30  APS  classrooms.  The 
CFI  was  administered  on  three  different  mornings  during  a 
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CFI  was  administered  on  three  different  mornings  during  a 
20-minute  observation  period  divided  into  100  12-second 
coding  intervals.     Observers  were  provided  with  timers  that 
clicked  every  12  seconds  and  were  instructed  ,t<D^record  what 
was  happening  to  a  selected  focus  child  at  the  time  of  the 
click.     For  each  coding  interval,  a  record  was  made  of  the 
specific  activity  in  which  the  child  was  engaged  and  the 
object  of  the  child's  attention.     As  for  the  AFI,  scores 
were  comr'  red  as  proportions  of  time  spent  in  each  specific 
activity.     Children  were  observed  during  teacher-directed 
activities  and  free-play  situations.     Data  for  each  activity 
type  were  analyzed  hot    separately  and  combined  across  the 
two  situations.     These  '^ombined  variables  are  believed  to 
reflect  overall  behavior  .patterns  during  the  day-care  day. 

Nine  CFI  variables^   vere  selected  for  investigation 
in  the  Atlanta  Public  Schools  study: 

•  MONITORS  ENVIRONMENT  (child  looks,  watches; 
does  not  include  listening) ; 

•  WANDERS   (child  has  no  apparent  purpose  in 
his  movement  about  the  center); 

•  GIVES  OPINIONS   (child  initiates  statements 
about  his  own  likes,  dislikes  or  preferences); 

•  GIVES  ORDERS  (child  issues  command  to  another 
child  or  caregiver); 

•  RECEIVES  ORDERS  (child  receives  commands  with 
which  compliance  is  expected); 

•  RECEIVES  INFORMATION  OR  HELP   (child  receives 
instruction,  materials  or  assistance  related  to 
his  task  in  the  solution  of  his  problem); 

•  RECEIVES  GENERAL  COMMENTS  (child  is  asked  for 
information  or  receives  comments  of  a  general 
nature) ; 

•  PARTICIPATES  IN  OPEN  ACTIVITY    (child  is  involvei 
in  an  activity  with  no  defined  goal);  and 

•  PARTICIPATES  IN  STRUCTURED  ACTIVITY   (child  is 
involved  in  an  activity  that  has  a  goal,  clear 
guidelines  for  carrying  out  the  task,  and  a 
defined  beginning  and  end)  . 
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Preliminary  analyses  of  the  CFI  data  (Connell,  1980) 
Indicated  that  the  observations  were  not  reliable  measures 
of  individual  child  behaviors,  but  that  they  were  accurate 
descriptors  of  classroom  process.     Therefore,  in  the 
APS,  as  in  the  57-center  study,  CFI  data  were  analyzed  at 
the  classroom  level. 

To  investigate  relationships  among  the  policy 
variables  and  the  CFI  data,  correlations  were  computed  for 
several  alternative  measures  of  the  policy  variables. 
Results  are  presented  in  Table  3.6.    Althoojh  there  are 
isolated  instances  of  inconsistency  across  variables,  the 
overall  pattern  of  correlations  was  strong  and  consistent. 
GROUP  SIZE  was  highly  correlated  with  children's  behavior, 
as  were  lead  teacher's  PREVIOUS  DAY  CARE  EXPERIENCE  and  lead 
teacher's  CENTER  EXPERIENCE.     NUMBER  OF  CAREGIVERS  also  was 
correlated  with  children's  behaviors,  with  approximately  the 
same  pattern  of  correlations  as  was  evidenced  by  GROUP  SIZE, 
although  the  correlations  were  not  as  strong.  STAFF/CHILD 
RATIO,  TOTAL  DAY  CARE  EXPERIENCE  and  LEVEL  OF  EDUCATION, 
however,  did  not  show  consistently  strong  relationships'with 
the  CFI  measures. 


PREVIOUS  DAY  CARE  EXPERIENCE  and  CENTER  EXPERIENCE 
both  showed  stronger  correlations  for  teachers  than  for 
aides;  otherwise  the  two  variables  behaved  quite  differently 
PREVIOUS  DAY  CARE  EXPERIENCE  seemed  to  be  more  important 
during  teacher-directed  activities,  while  the  CENTER  EXPERI- 
ENCE correlations  were  higher  for  free-play  situations,  m 
addition,  the  signs  of  the  correlations  were  usually  opposite 
for  the  two  experience  variables.     The  pattern  suggests  that 
lead  teachers  with  varied  experience  in  day  care  are  found 
in  classrooms  in  which  children  are  more  involved,  especially 
during  teacher-directed  activities,  and  conversely,  that 
lead  teachers  who  have  worked  in  only  one  setting  over  a 
period  of  ti'!.,e  are  found  in  classes  where  children  are  less 
involved,  particularly  during  free  play. 
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Regression  models  also  were  developed  to  predict 
each  of  the  nine  CFI  variables.     Correlation  analyses  had 
indicated  that  the  observed  policy  variables  generally  „ere 
at  least  as  highly  correlated  with  children's  behaviors  as 
the  child-focus  or  individual  caregiver  variables,  since 
the  Child-Focus  Instrument  did  not  record  which  caregivers 
were  present  during  the  actual  child-focus  observations,  the 
observed  background  variables  were  felt  to  provide  a  more 
accurate  representation  of  caregiver  qualifications  for  the 
observation  period.     Therefore,  the  observed  classroom 
composition  and  staff  background  variables  were  used  for 
regression  model  development. 

The  results  of  the  regression,  analyses  are  sum- 
marized in  Table  3.7;  details  of  the  analyses  are  provided 
in  Tables  A. 12  to  A. 14,  Appendix  A.     Separate  regressions 
were  run  for  GROUP  SIZE  and  NUMBER  OF  CAREGIVERS  since  these 
two  variables  were  highly  correlated  in  the  sample  (r=.70). 
Other  variables  included  in  the  regressions  were  LEVEL  OF 
EDUCATION,    STAFF/CHILD  RATIO,   PREVIOUS  DAY  CARE  EXPERIENCE 
and  CENTER  EXPERIENCE. 

Although  no  single  model  consistently  emerged  for 
all  the  child-focus  variables,  several  patterns  are  evident. 
GROUP  SIZE  was  the  most  consistently  significant  predictor: 
children  in  smaller  groups  received^nf ormation  and  orders 
more  often,  gave  more  opinions  and ^participated  in  structured 
activities  more  frequently.     Children  in  larger  groups,  on 
the  other  hand,  were  more  likely  to  monitor  the  environment 
and  wander.     Caregivers  with  more  previous  day  care  experience 
were  found  in  classes  in  which  children  were  more  involved  while 
caregivers  with  more  center  experience  had  children  who  were 
less  involved.     These  results  paralleled  the  findings 
suggested  by  the  correlation  analyses. 
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Table  3.7 


SUMMARY  OF  POLICY  VARIABLES:    CHILD  FOCUS  RBGRESSION  RESULTS 


Teacher-Di  rected 
Variables  Sign 

R^ 

Free  Play 
Predictor 

Sign 

Combination 
Predictor  Sign 

Moni  tors 
Envi  ronment 

Group  Size* 
(i  Caregivers] 

(+) 
(+) 

.21 
.18 

(Group  Size) 

(+) 

.11 

Group  Size** 

(+) 

.24 

Wanders 

Group  Size* 
S/C  Ratio* 
(i  Caregivers 

(+) 
(+) 
(+) 

.21 
.30 
.16] 

(Center  Exp.) 

(+) 

.10 

Prev.  D.C.  Exp. 
(Center  Exp.) 

(-) 
(+) 

.26 
.35 

Gives  Opinions 

(Grp.  Size) 

(-) 

.10 

1  Caregivers* 

(-) 

.16 

(Group  Size) 

(-) 

.15 

Gives  Orders 

(Group  Size) 

(+) 

.10 

(Center  Exp.) 

(+) 

.079 

(Center  Exp.) 

(+) 

.11 

Receives  Orders 

(Prev.  D.C.  Exp.) 

(+) 

.12 

Group  Size** 

(-) 

.22 

Center  Exp. 

(-) 

.14 

Receives  Info. , 
Help 

Prev.  D.C.  Exp.**  (+) 

Group  Size  (-) 

.28 
.42 

(Group  Size) 

(-) 

.10 

Group  Size** 
(i  Caregivers** 

(-) 
(-) 

.52 
.25] 

Receives  General 

(Cfenter  Exp.) 

(-) 

.098 

Center  Exp.* 

(-) 

.17 

Center  Exp.* 

(-) 

.20 

Part,  in  C^en  Act. 

(Prev.  D.C.  Exp.) 

(-) 

.12 

Ctenter  Exp.** 

(+) 

.30 

Center  Exp.** 

(+) 

.30 

Participate  in 
Structured  Act. 

Group  Size* 
[(1  Caregivers) 

(-) 
(-) 

.17 
.078] 

Center  Exp.* 

(-) 

.15 

(Group  Size) 

(-) 

.15 

*p<.05 
**p<.01 

(  )  not  Significant,  but  entered  first. 
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CPA  Checklist  Observations 

Caregivers'  skills  and  behaviors  were  also  measured 
by  means  of  a  checklist  developed  for  the  NDCS  based  on  the 
Child  Development  Associates  (CDA)  credentialing  system 
(N.  Goodrich,  1980).     luems  on  the  NDCS  checklist  were 
culled  from  a  number  of  actual  CDA  observations  recorded  as 
part  of  the  credentialing  process;  the  items  were  organized 
to  reflect  the  functional  areas  specified  by  the  CDA. 
Factor  analyses  were  performed  within  areas  to  identify  one 
or  two  distinct  factors  to  describe  caregivers  skills. 
These  factors  subsequently  were  factor-analyzed  to  identify 
four  major-construct£-child  orientation,  classroom  manage- 
ment,  resources,  and  physical  environment,     m  addition, 
an  overall  CDA  rating  scale  was  developed  from  the  original 
factors. 

The  CDA  Checklist  was  completed  by  observers 
following  the  AFI  obseration  period,     only  one  Checklist  was 
recorded  per  day,  ostensibly  for  the  lead  teacher -although 
two  caregivers-a  teacher  and  an  aide-might  have  been 
observed  with  the  AFI.     Thus,  the  Checklist  data  probably 
reflect  the  skills  and  behavior  of  more  than  one  caregiver. 
Given  this  situation,  the  CDA  instrument  must  be  viewed  as  a 
measure  of  cI«3sroom  process  and  not  of  individual  caregivers. 

Correlations  with  the  policy  variables  were  computed 
for  the  five  constructs  and  the  twelve  factors  defined  for  the 
CDA  analyses  (Table  3.8).     Because  of  the  high  correlations 
among  the  CDA  factors  and  the  difficulties  in  interpreting 
figures  for  twelve  different  factors,  results  are  discussed 
for  the  five  constructs;  data  for  the  twelve  factors  are 
presented  only  to  provide  supporting  evidence. 

The  pattern  of  correlations  suggests  that  smaller 
:lasses,  higher  ratios  and  more  previous  day  care  experience 
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Group  Size 

|-.35*| 

-.40*1 

-.19 

-.56** 

-.44**  .19  -  1 

1 

-.47** 

-.31* 

1  1 
-.47**-  1 

1  1 

-.221  -  1 

-  -.32*1 

Nunber  of 
Caregivers 

1  .21  1 

-  .54**- 

1  1 
-  1  .37*1 

1  1 

-  .56**1 

.211  .301 

.36*  -  1 

Staff/Oiild 
Patio 

1.43**1 

.39*1 

.46** 

.33*  ,26 

1  1 
.251  .40*1 

1  1 

-  .49**1 

.36*1.45**1 

.30  .39*1 

Center  Exp, 

** 

.33* 

-     .31*  - 

.20 

-  1  -  1 

1  1 

-  1  -.221 

-  -.271 

Previous  Day 
Care  Experience 

1.52**1 
1  1 
1 
1 

1  1 

.48**1 

.62** 

.34* 

,46**-  .54** 

,51**1 

.19 

1  1 
.58**.41*| 

1  1 

.50**  - 

.43**1  -  1 

-  .37*1 

Level  of 
Education 

.37* 

.20  -  ,25 

,36*1 

.32* 

1  1 

1  1 

^  TpU5 

"■—Correlations  are  reported  only  for  p  <.15. 
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for  caregivers  are  associated  with  higher  CDA  ratings.  No 
significant  correlations  were  found  for  CENTER  EXPERIENCE 
with  any  of  the  factors  or  constructs.     NUMBER  OF  CAREGIVERS 
Showed  a  few  high  correlations  but  was  not  as  strongly 
associated  with  the  CDA  measures  as  were  the  other  classroom 
composition  variables.     The  overall  pattern  is  consistent 
with  the  API  results,  which  indicated  that  caregivers  were 
more  active  in  smaller  scale  environments.  - 

Regression  models  for  each  factor  and  construct 
are  displayed  in  Table  A.15,  Appendix  A.     Both  PREVIOUS  DAY 
CARE  EXPERIENCE  and  STAFF/CKILD  RATIO  were  good  predictors 
of  caregivers,  behavior  and  were  the  only  policy  variables 
included  m  the  regression  model.     STAFF/CHILD  RATIO  was 
TZ.f.T''  ^"-i^^-'^  with  the  classroom  environment 
(PHYSICAL  ENVIRONMENT;   RESOURCES)    while  PREVIOUS  DAY  CARE 
EXPERIENCE  was  the  strongest  predictor  of  caregiver  activity 
(CIASSROOM  MANAGEMENT;  CHILD  ORIENTATION).     Despite  signi 
ficant  correlations  with  many  of  the  CDA  variables,  GROUP 
SIZE  did  not  emerge  in  the  regressions  as  a  good  predictor 
of  caregivers,  skills  and  behaviors,     since  the  teacher-focus 
measures  of  GROUP  SIZE  and  STAFF/CHILD  RATIO  had  a  correlation 
of  -.44,  the  effects  of  STAFF/CHILD  RATIO  simply  outweighed 
the  effects  of  GROUP  <;t7p  i„  c 

OL  ^Huup  SIZE  m  the  forward  stepwise  regression 
used  m  the  analysis. 


465 


9 


CHAPTER  FOUR;     ANALYSES  OF  CLASSROOM  PROCESS 


Relationships  between  Adult-Focus  and  Child- 
Focus  Variables 

Although  the  AFI  and  CFI  observations  were  made 
during  the  same  time  period  (April-May  1977),  they  were  not 
conducted  simultaneously.     Thus,  there  is  no  direct  record 
of  how  children  and  caregivers  interacted  with  each  other. 
Since  both  the  AFI  and  CFI  data  represent  averages  of 
behaviors  over  several  days,  it  is  reasonable  to  examine 
associations  between  average  caregiver  behavior  and  average 
child  behavior.     These  analyses,  however,  should  not  be 
viewed  as  evidence  of  causal  relationships,  but  only  as  in- 
dications of  associations  among  ongoing  classroom  processes. 

Process  relationships  were  examined  by  computing 
correlations  between  children's  behaviors  (combination 
teacher-directed  and  free-play)  and  both  teachers'  and 
aides'  behaviors.     Additional  correlations  between  child  and 
adult  behavior  were  also  obtained  by  caregivers'  level  of 
education.     The  results  are  summarized  in  Tables  4.1  to  4.3. 
Actual  correlations  are  presented  in  Tables  A. 16  to  A. 21  in 
Appendix  A. 

Overall,  the  correlational  pattern  obtained 
suggests  that  the  AFI  and  CFI  observations  represent  a 
continuing  classroom  process.    The  correlations  do  not 
create  a  clearly  defined  picture  of  the  relationships 
between  child  and  adult  behavior,  but  rather  point  toward 
certain  configurations  of  classroom  process  that  are 
evident  in  both  behavior  codes.     For  example,  caregivers 
who  interacted  more  with  the  children  (more  instructing, 
social  interaction  and  management  behavior)  were  found  in 
classes  where  children  were  more  involved   (giving  orders, 
receiving  orders,  receiving  information).     On  the  other 
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Figure  4.1 

SUWftRY  OF  ADULT  FOCUS  AND  CHILD  FOCUS  BEHAVIORS 
TEACHER-DIRtrru)  AUD  FREK-PLAY  ACTIVITIES  mMRTMph 


1  CAREGIVERS  

|For  Both  Teachers  and  AiHoc. 

CHILDREN 

1    •  more  social  interaction 

1     •  more  participating  in  closed  | 
1        group  activity  i 

•  more  receiving  information,  help  | 

iFor  Teachers  Onlv 

1    •  more  social  interaction 

•  more  giving  opinions  i 

•  less  wandering  i 

1    •  more  management  behavior 

•  less  giving  orders  i 

1    •  more  center  activity  | 

•  more  giving  orders  i 

iFor  Piidez  Only;  i 

1    •  more  social  interaction  | 

•  less  monitoring  environment  | 

•  less  participating  in  open  group  1 
activity 

1    •  more  management  behvaior  | 

•  more  giving  opinions  i 

•  more  receiving  orders  i 

1    •  more  adult  activity  | 

•  more  doing  nothing,  vgandering  | 

•  less  receiving  information  i 

•  less  receiving  orders  i 

1    •more  observing  i 

•  more  participating  in  open  group  1 
activity 

•  less  receiving  information,  help  | 
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Figure  4,2 

SUMMARY  OF  ADULT  FOCUS  AND  CHILD  FOCUS  BEHAVIORS 
TEACHER-DIRECTED  ACTIVITIY 


CARECIVERS  I 

CHIU^^  1 

For  Both  Teachers  and  Aides:  I 

•  more  social  interaction  I 

•  less  monitoring  environment  I 

•  less  doing  nothing,  wandering  j 

1    •  more  adult  activity  j 

•  less  receiving  infonnation,  help  I 

IFor  Aides  Only:  I 

1    •  morcf  social  interaction  I 

•  more  participating  in  closed  group  I 
activity  | 

1    •more  management  behavior  I 

•  more  participating  in  open  group  I 
activity  | 

1    •more  adult  activity  I 

•  more  doing  nothing,  wandering  I 

1    •  more  center  activity  | 

•  more  receiving  infonnation,  help  I 

1    •  more  instructing  | 

•  more  participating  in  clc^^sd  group  I 
activity  j 

•  less  doing  nothing,  wandering  I 

iFOr  Teachers  Only  | 

1    •more  social  interaction  I 

•  more  receiving  information,  help  I 

1    •  more  management  behavior  I 

•  more  participating  in  open  group  I 
activity  | 

1    •more  observing  | 

•  less  participating  in  open  group  I 
activity  | 

1    •  more  adult  activity  I 

•  more  monitoring  environn.tnt 

•  less  participating  in  open  group 
activity 

•  less  participating  in  closed  group 
activity 

•  more  giving  opinions 
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Figure  4.3 

SUWMftRY  OF  ADULT  POn?S  AM-n  CHILD  TOCUS  BEHAVIORS 
FR£E-PLAY  " 


CAREGIVERS 


CHILDREN 


IFor  Both  Teachers  and  Aides; 

•  more  instructing 

IFor  Teachers  Only 

•  more  social  interaction 


more  nanagonent  behavior 


more  center  activity 


iFor  Aides  Only; 

•  more  social  interaction 


•  more  manageriient  behaior 


•  more  adult  activity 

•  more  observing 

•  more  instructing 

•  more  center  activity 


more  receiving  information,  help 


•  ^®ss  doing  nothing,  wandering 

•  less  participatir^  in  open  group 
activity 

•  more  giving  opinions 

•  more  receiving  information,  help 

•  more  giving  opinions 

•  less  giving  orders 

•  less  giving  opinions 

•  more  giving  orders 

•  less  receiving  general  comment 


•  less  monitoring  em'ironment 

•  less  participating  in  open  group 
activity 

•  more  participating  in  closed  qroup 
activity 

•  more  receiving  orders 

•  less  participating  in  open  qroup 
activity 

•  more  giving  opinions 

•  more  receiving  orders. 

•  more  receivir^  information,  help 

•  more  receiving  general  comnent 

•  less  receivir^  information,  help 

•  less  receiving  information,  help 

•  more  receiving  orders 

•  less  participating  in  closed  group 
activity  •  . 
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hand,  caregivers  who  Interacted  with  children  less  often 
(more  adult  activity,  center  activity  and  observing)  were 
associated  with  children  who  were  less  involved  (more 
monitoring  and  wandering,  less  giving  and  receiving) •  The 
correlations  also  showed  a  consistent  relationship  between 
children's  participation  in  closed  group  activities  and 
involved  caregivers  and,  conversely,  between  children's 
participation  in  open  group  activities  and  uninvolved 
caregivers. 

Relationships  Between  CPA  and  Adult-Focus  Variables 


tions  were  computed  between  the  major  constructs  defined  for 
each  instrument.     The  results  (Table  4.4)   show  a  consistent 
pattern  for  both  teachers  and  aides.     Caregivers  who  received 
higher  CDA  ratings  engaged  in  more  social  interaction  and 
center  activity  and  less  observing  and  adult  activity.  CDA 
ratings,  however,  were  not  significantly  related  to  either 
instructing  or  management  behavior  in  the  APS  sample. 


after  the  Adult-Focus  Observations  were  made,  the  correla- 
tional pattern  is  not  surprising.     Many  of  the  items  on  the 
CDA  Checklist  refer  to  specific  activities  concerning 
interaction  with  children  or  classroom  management.  Care- 
givers who  did  these  things  should  have  been  recorded  more 
often  as  praising,  responding,  comforting,  or  engaging  in 
center-related  activity.     Thus  to  a  large  extent  the  CDA 
variables  represent  another  measure  of  caregiver  behavior, 
with  a  greater  emphasis  on  skills  than  the  Adult-Focus 
Instrument  contains. 

Relationships  Between  CDA  and  Child-Focus  Variables 

Correlations  between  the  CDA  variables  and 
the  CFI  variables  are  shown  in  Table  4.5.     Several  consistent 


To  examine  CDA/AFI  relationships,  correla- 


Since  the  CDA  Checklist  was  recorded  immediately 
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Table  4.4 
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Table  4.5 

PEARSON  CX3RRELATI0WS  FOR  CCA  AND  CHILD  FOCUS  VARIABLES 
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Free  Play 
Tc.'KHiPr  Dlrert-rrl 

Ojicn 

Frp*»  Pl*Ty 
Te.-K^ier  Dl  rectr«il 

St  riicture 
Free  rl.ty 
Tenrher  Directed 

••iX.Ol 

(jor relation;:  nre 


51**1 

-.M**| 

-.51** 

-.21 

-.50* 

-.3fi* 

-.«* 

-.53* 

-.v.*  1 

-.35*  1 

-.4d**| 

-.30* 

-.57 

-.36* 

-.30* 

-.34 

-.47  1 

-.45**| 

-.5ri**l 

-.23 

-.52**1 

-.61**| 

-.23 

-.71** 

-.22 

-.47** 

-.35* 

-.32* 

-.32* 

-.2fi  1 

-.19  1 

-.39*  1 

-.35* 

-.61*  1 

I-.37* 

1 

'.27*  1 

-.23 

-.37* 

-.31* 

-.26 

|-,42** 

-.51** 

-..10*  1 

42** 

-.30*  1 

.21 

-.27  1 

-  1 

.26 

i-.35* 

-,42** 

-.19 

|-.40*» 

-.39*  1 

-.33* 

-.19 

-.20 

I-.26 

-.32* 

h.39*  1 

-.48** 

-.30*  1 

-.2f,  1 

-.27 

1 

-  1 

.20 

1  .22 

.23 

I-.20  1 

-.24 

-  1 

.21 

I-.19  1 

-.24 

1 

-  1 

1  .22 

1  .24 

.19 

- 

- 

-.24 

1  .21 

.28 

I-.25 

- 

-.29 

-.25 

1  - 

- 

I-.20 

.3r,* 

I-.1)* 

.12* 

1  - 

.35* 

I-.31* 

1  - 

- 

.19 

I-.21 

I-.20 

.37 

1  .4l»» 

1  .32* 

.22 

.3f>* 

.29 

1  .23 

.29 

1  .5I** 

.57** 

.34* 

.4S** 

I-.31* 

.21 

1  - 

.22 

.19 

.24 

-.22 

1  .48»* 

1  ,AA*» 

.45** 

.39* 

.35* 

.25 

1  .2B 

.30 

1  .SO** 

.40** 

.3f.* 

.4n** 

.14* 

1 

I-.20 

- 

-.4f>»* 

-.19 

I-.54** 

-.45** 

-.52** 

I-.42** 

I-.42** 

h.30* 

- 

-.24 

-.29 

-.57" 

-.32* 

I-.22 

I-.30* 

I-.45** 

-.27 

-.50** 

|-.3fl* 

I-.24 

-.78 

1  .25 

1  - 

-.26 

I-.39** 

-.31* 

-.29 

I-.43** 

-.20 

1 

1  - 

.19 

1  .27 

1  .?3 

.19 

1  - 

.25 

1  .22 

1  .21 

I-.33* 

I-.21 

1  .19 

l-.fiO** 

I-.S9** 

-.41** 

I-.59** 

1  .23 

-.12* 

1  .33» 

1  ..IM 

1 

1  ' 

.34* 

.31» 

.21 

.20 

!  .37* 

.47** 

1  .37* 

.26 

1  - 

.25 

I-.19 

.19 

1  .47»* 

1  .37* 

1  .25 
1 

.34* 

.37» 

.24 

.23 

1  .f1** 

1  .44** 

.sn** 

1  .sri** 

reimrtcd  for  iK.15  ocily. 
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patterns  are  present.     Caregivers  with  higher  CDA  ratings 
were  found  in  classrooms  in  which  children  monitored  the 
environment  or  wandered  frequently  and  received  more  infor- 
mation and  help.     These  relationships  were  especially  strong 
during  teacher-directed  activities,  when  the  caregiver  might 
be  expected  to  be  in  more  direct  contact  with  children.  The 
CDA  ratings  also  were  associated  with  children's  receiving 
fewer  general  comments  and  with  children's  participating  in 
structured  rather  than  open  activities.* 

Even  though  the  CDA  and  Child-Focus  Instruments 
were  not  recorded  at  the  same  time,  the  CDA/CFI  relation- 
ships suggest  that,  as  with  the  AFI,  the  behaviors  recorded 
represent  an  on-going  classroom  process.     Children  in 
classes  with  higher  CDA  ratings  tended  to  receive  more  from 
the  caregiver  and  to  be  more  involved,  particularly  in  a 
structured  activity.     The  effect  of  caregivers'  skills  and 
behaviors  is  less  evident  during  free-play  situations, 
except  on  children's  monitoring  of  the  environment  and 
receiving  general  comments.    The  fact  that  these  relation- 
ships are  evident  despite  the  difference  in  observation 
times  helps  to  confirm  the  validity  of  both  instruments. 


be  emphasized  that  no  attempt  has  been  made  to 
^nnf  -J^  ^'^^^"^  ^'^"^'^  °^  ^^'^^  behaviors  as  "goSd"  or  "bad 
J^e  an"s  t^at^on'and'"^^:  °^  "^'^  depending  on'the''' 

?^e "Jdgmen?!     °"  perspective  of  the  person  making 
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CHAPTER  FIVE;     ANALYSES  OF  CLASSROOM  PROCESS  AND 
CHILDREN'S  COGNITIVE  GAINS 

Relationships  between  Adult-Focus  Variables  and  Gain  Scores 

The  relationships  between  the  adult-focus  vari- 
ables and  children's  generalized  cognitive  gain  scores  were 
examined  for  both  teachers  and  aides.     Correlations  (Table 
5.1]   indicate  that  in  the  APS  study  aide  behaviors  were  more 
strongly  associated  with  children's  cognitive  gains  than 
were  teacher  behaviors.    The  AFI/policy  variable  analyses 
also  suggested  that  aides  were  more  influenced  than  teachers 
by  the  policy  variables,  especially  by  classroom  composition 
(see  Chapter  Three) .     The  effects  of  relevant  policy  vari- 
ables were  therefore  removed  through  partial  correlations. 
The  resulting  AFI/PSI  correlations  for  aides  were  much  less 
significant;  the  AFI/PPVT  correlations  for  both  aides  and 
teachers,  however,  remained  stable. 

This  finding  is  of  particular  interest  if  one  is 
willing  to  place  a  causal  "chain-of  effects"  model  on  these 
data.     Suppose  that  interest  lies  with  understanding  the 
relationships  between  adult  behavior  and  child  outcomes.  It 
is  known,  however,  that  caregiver  qualifications  and  classroom 
composition  are  associated  with  both  of  these  measures.  If 
one  assumes  that  these  policy  variables  are  in  a  sense  "ex- 
ternal inputs"  to  the  system  that  may  mediate  between  process 
and  outcome,  then  by  first  partialing  out  these  effects,  it 
is  possible  to  determine  if  classroom  composition  and  care-  - 
giver  qualifications  are  the  determinants  of  child  outcomes 
or  if  it  is  really  process  that  influences  cognitive  gain 
scores. 

In  the  context  of  this  model,  then,  these  findings 
suggest  that  the  effects  of  adult  (aide)   behavior  on  PSI 
gain  scores  nay  be  attributable  to  the  prevailing  classroom 
composition  (group  size,  staff/child  ratio),  but  that  PPVT 


Table  5.1 


PEARSON  CORRELATIONS  FOR  ADULT  FOCUS  VARIABLES 
AND  COGITIVIE  GAIN  SCORES  


Instructs 
Teachers  (N-30) 
Aides  (N-22) 

Adult  Activity 

Teachers 

Aides 


::enter  Activity 

Teachers 

Udes 

Dbserves 
Teachers 
Vides 

igmt>  Behavior 

'eachers 

ddes 

tocial  Interact. 

'eachers 

ides 

egative 
eachers 
ides 

ositive 
eachers 
ides 


PSI  Gains 


-.51** 


-.27 
-.25 


.20 


.44** 


.25 


PSI  Gains 
Remcving 
Group 
Score  & 
S/C  Ratio 


-.24 


.27 


-.21 


-.25 
.25 


.25 


PPVT  Gains 


.28 


-.32 


-.  20 
-.35* 


-.45* 


.30* 
.26* 


.22 
.38* 


PPVr  Gains 
Removing 
Previous  Day 

Care 
Experience 


.27 


-.28 


.20 
.40* 


-.20 
.42* 


.44* 


.21 
.33 


PPVT  Gains 
Removing  Group 
Size,  S/C  Ratio, 
Previous  Day  Carel 
Experience 


*p<.05 
*p<.01 

Drrelations  are  reported- for  p<.15  only. 


.31 


-.32 
-.50* 


.20 
-.38* 


-.21 
.49* 


.56** 


.20 
.24 


.21 
.40* 


475 

49S 


gain  scores  are  more  likely  to  be  associated  with  adult 
behavior.     PPVT  gain  scores  were  not  Initially  as  Influenced 
by  classroom  composition,  and  the  pattern  of  correlations 
remained  stable  when  the  classroom  composition  .variables  and 
PREVIOUS  DAY  CARE  EXPERIENCE  were  first  partlaled  out.  In 
fact  the  correlations,  especially  for  aides,  tended  to 
Increase  after  the  effects  of  the  composition  variables  were 
removed.     If  one  accepts  this  chaln-of-ef f ects  model,  these 
results  suggest  that  classroom  composition  rather  than 
caregiver  behavior  Is  related  to  PSI  gain  scores,  and  that 
caregiver  behavior  rather  than  qualifications  or  classroom 
composition  Is  associated  with  PPVT  gain  scores. 

The  correlational  pattern  Indicates  that  aides  who 
showed  more  social  Interaction  and  management  behavior  were 
associated  with  higher  PPVT  gain  scores,  while  aides  who 
were  more  often  Involved  In  adult  or  center-related  actlvltl-es 
were  associated  with  lower  PPVT  gain  scores.     These  relation- 
ships, however,  did  not  hold  for  lead  teachers:  teachers 
who  evidenced  less  management  behavior  and  more  center 
activity  were  associated  with  greater  PPVT  gains.  The 
Inconsistent  findings  for  teachers  and  aides  are  not  easily 
explained  and  are  not  replicated  In  the  57-center  study. 
This  provides  evidence  that  the  reasslgnments  made  for  the 
experimental  design  may  have  caused  the  anomalous  results 
(see  Chapter  Three)  . 

Regression  analyses  (Tables  A. 22  and  A. 23,  Appendix 
A)  also  suggest  that  aide  behaviors  were  not  strong  predictors 
of  PSI  gains  after  the  effects  of  GROUP  SIZE  and  STAFF/CHILD 
RATIO  were  removed.     The  regressions  did  Indicate,  however, 
that  for  lead  teachers  SOCIAL  INTERACTION  and  OBSERVES  were 
significant  predictors  of  PSI  GAIN.     In  fact,  the  teacher- 
focus  social  Interaction  variable  became  a  stronger  predictor 
after  the  classroom  composition  variables  were  considered. 
GROUP  SIZE,  however,  remained  the  best  predictor  of  PSI  GAIN 
for  both  teachers  and  aides.     Regression  results  for  the 


PPVT  showed  that  MANAGEMENT  BEHAVIOR  for  lead  teachers 
(especially  CORRECTS)  and  SOCIAL  INTERACTION  for  aides  were 
the  best  predictors  of  PPVT  GAIN. 

The  correlation  and  regression  results  together 
suggest  that  caregiver  behavior,  particularly  SOCIAL  INTER- 
ACTION, is  associated  with  children's  cognitive  gains  in 
the  APS  sample.     Both  PREVIOUS  DAY  CARE  EXPERIENCE  and  the 
caregiver  behavior  variables  were  good  predictors  of  PPVT 
GAIN,  while  GROUP  SIZE  remained  the  best  predictor  of  PSI 
GAIN.     Although  aide  behaviors  appeared'to  be  related  to  PSI 
gains,  the  effects  disappeared  after  group  size  was  considered 
however,  teacher  behaviors,  which  were  less  influenced  by 
group  size,  continued  to  be  associated  with  PSI  gain  scores. 

Relationships  between  Child-Focus  Variables  and  Gain  s.nr.. 

Correlations  between  the  child-focus  variables  and 
children's  cognitive  gain  scores  are  presented  in  Table  5.2. 
The  pattern  provides  evidence  that  children's  behaviors 
were  more  closely  associated  with  changes  in  PPVT  scores 
than  with  changes  in  PSI  scores.     After  the  effects  of 
classroom  composition  were  removed,  only  two  CFI  variables- 
GIVES  OPINIONS  during  teacher-directed  activities  and  GIVES 
ORDERS  during  free  play-were  significantly  correlated  with 
PSI  GAIN.     Although  removing  PREVIOUS  DAY  CARE  EXPERIENCE 
from  the  CFI/ppvt  correlations  generally  decreased  the 
values  obtained,  a  number  of  significant  relationships 
remained.     PARTICIPATES  in  STRUCTURED  ACTIVITY  (for  example 
games  with  rules,  working  puzzles  or  coloring)  was  positively 
and  significantly  correlated  with  PPVT  GAIN  while  MONITORS 
ENVIRONMENT,  WANDERS  and  PARTICIPATES  IN  OPEN  ACTIVITY 
(for  example,  riding  bikes,  drawing  pictures  or  building 
with  blocks)  were  negatively  correlated  with  PPVT  GAIN. 
GIVES  ORDERS  and  RECEIVES  INFORMATION,  especially  during 
free  play,  were  also  positively  associated  with  PPVT  GAIN. 
Including  GROUP  SIZE  and  STAFF/CHILD  RATIO  in  the  PPVT 
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Table  5.2 


PEARSON  CORREIATIONS  FOR  CHILD  FOCUS  VARIABLES 

 M)  CtotlflVE  GAlN  acaft^S  

(N-30) 


Mon.  Envir.  | 

Combined  | 

-.23 

Teacher  Directed  I 

Free  Play  | 

-»21 

Vteuiders  | 

Combined  I 

Teacher  Directed | 

-.28 

Free  Play  | 

Gives  Opinions  | 

Combined  | 

.19 

Teacher  Directed  I 

.57** 

f  ree  riay  \ 

Gives  Orders  I 

Combi  ned  | 

Teacher  Directed  I 

free  fiay  i 

Receives  Orders  | 

Combi  ned  | 

Teacher  Directed  I 

-.22 

Free  Play  | 

.33* 

Receives  Info.  I 

Combined  | 

.46** 

Teacher  Directed  I 

.26 

Free  Play  | 

•  21 

Receives  General! 

Combi  ned  I 

Teacher  Directed | 

.21 

Free  Play  I 

Open  Activity.  1 

Combined  | 

-.36* 

Teacher  Directed  I 

Free  Play  | 

Structured  Act.  1 

Combi  ned  | 

.23 

Teacher  Directed  I 

.25 

Free  Play  | 

PSI  Gains 


PSI  Gains 
Adjusting 
for  Group 
Size  and 
S/C  Ratio 


.21 


.51** 
-.26 


.25 
.41* 

-.30 


.22 


PPVT  Gains 


.32 
.19 
.42** 


.49** 

.36* 

.33* 


.20 

.28 
.40** 


.32* 

.20 

.32* 


.41** 
.34* 


.50** 
.44** 
.33* 


PPVT  Gains 
Adjusting 
for  Previous 
Day  Care 
Experience 


-.33* 


.32* 

.21 

.24 


.26 

.31* 
-44** 


.32* 


.41** 

.21 

.20 


.47** 

.40* 

.36* 


PPVT  Gains 
Adjusting  for 
Prev.  Day  Care 
Experience,  group 
Size  &  S/C  Ratio 


*p<.05 
**p<.01 

Correlations  are  reported  for  p<.15  only. 


-.21 
-.37* 


.32* 

.22 

.24 


.27 

.34* 
.45** 


.19 
•  33* 


.45** 

.22 

.19 


.50** 
.43** 
.36* 
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partial  correlations  did  not  change  the  correlational 
patterns. 

In  the  initial  regression  analyses,  child-focus 
variables  were  used  to  predict  gain  scores  by  type  of 
observation  (teacher-directed  activity,  free  play,  combined). 
Regressions  also  were  computed  first  taking  into  account  the 
effects  of  selected  policy  variables.     The  results  (Tables 
A. 24  to  A. 26,  Appendix  A)  corroborated  the  correlational 
findings  and  emphasized  that  PPVT  gain  scores  were  especially 
influenced  by  the  free-play  variables. 

After  the  effects  of  classroom  structure  were 
taken  into  consideration,  the  only  child-focus  variable  that 
remained  a  significant  predictor  of  PSI  GAIN  was  GIVES 
OPINIONS  during  teacher-directed  activities  (p=.058).  ppvt 
gains,  however,  were  influenced  by  several  free-play  variables 
even  after  the  effects  of  PREVIOUS  DAY  CARE  EXPERIENCE  were 
removed  from  the  model.     GIVES  ORDERS,  PARTICIPATES  IN  OPEN 
ACTIVITY,  MONITORS  ENVIRONMENT  and  RECEIVES  INFORMATION 
each  significantly  predicted  PPVT  GAIN. 

While  it  is  difficult  to  interpret  the  regression 
models  that  include  the  isolated  significant  predictors, 
two  interesting  patterns  do  emerge.     First,  children's 
behaviors  were  more  strongly  related  to  PPVT  gain  scores 
than  to  PSI  gain  scores  in  the  Atlanta  Public  Schools  day 
care  centers.     Second,  child  behavior  during  teacher- 
directed  activities   (especially  GIVES  OPINIONS)  was  more 
closely  associated  with  PSI  gain,  scores,  whereas  child 
behavior  in  free-play  situations  seemed  to  be  more  strongly 
related  to  PPVT  changes. 

Relationships  between  rnA  variables  .n^  r..,-.  c  

Simple  and  partial  correlations  for  the  CDA  vari- 
ables and  PSI  and  PPVT  gain  scores  are  shown  in  Table  5.3. 
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Table  5.3 

PEaPSCN  OORRELKTIONS  FOR  CPA  VARIABLES  AND  OOGNTTIVE  GMN  SCORES 


1 

IPSI  Cbn-  1 

1  PPVT 

PPVT  Controlling  1 

j 

I  trolling  I 

1 controlling 

for  Previous  Day  I 

1  Lor  vjroupi 

lior  rxevious 

Care  Experience  | 

1 

ISize  and  | 

1    Day  Care 

Group  Size  and  | 

1 

PSI 

js/C  Ratio  1 

PPVT 

1  Experience 

Staff/Child  Ratio 1 

•  DO 

1  /!*5 
1  •*±Z 

1             .45  1 

Child  Orientation  j 

.19 

1  1 
1  1 

.44 

1  .30 

1           .31  1 

1 

Encourages  Active  Play  I 

I  1 
1  1 

.31 

1 
1 

Qicourages  Cognite/  | 

1  1 

1 

Language  Development  I 

.26 

j  1 

.40 

1  .30 

1           .31  1 

Concept  1 

.47 

1  .33 

.35  1 

Encourages  Self  Help  j 

I  1 

1 

Encourages  Soc.  Behav.  j 

1  1 

.46 

1  .32 

1           .32  1 

Classroom  Managanent  j 

.25 

.43** 

1  .33* 

1           .33*  1 

Encourages  Safety  j 

.27 

Manages  Class  Act.  Well) 

.21 

.52** 

1      .41**  • 

1           .42**  1 

Resources  j 

.43** 

1    .29**  1 

.56** 

1  .45** 

1           .48**  1 

Provides  Gross  Motor  j 

Materials.  j 

.37* 

1     .28*  1 

.49** 

1  .36** 

1           .37*  1 

Provides  Createive  j 

Play  Materials  | 

.49** 

1     .37*  1 

.45** 

1  .41** 

1           .44**  1 

Arranges  Classroom  Vlell\ 

.24 

.52** 

1  .38* 

"           .41*  1 

Physical  Environment  1 

-.04 

.08 

Maintains  Safe  Classrm.j 

-.12 

1  -.07 

Maintains  Sanitary  I 

Classroom  j 

.24 

*p<.05 
**p<.01 

Correlations  are  reported  for  p<.15  only. 
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Analyses  of  the  CDA  variables  and  the  policy-variables 
(see  Chapter  Three)   indicated  that  CDA  ratings  were  influ- 
enced by  both  staff/child  ratio  and  caregivers'  previous  day 
care  experience.     Although  several  CDA  variables  had  signifi 
cant  or  nearly  significant  correlations  with  PSI  gain 
scores,  the  effects  were  greatly  diminished  if  GROUP  SIZE 
and  STAFF/CHILD  RATIO  were  first  considered;  only  one 
correlation,  CREATIVE  PLAY  MATERIALS  with  PSI  GAIN,  then 
remained  significant..    The  overall  CDA  rating  was  signifi- 
cantly correlated  with  PSI  GAIN,  but  the  correlation  became 
insignificant  if  the  effects  of  the  classroom  composition  ' 
variables  were  first  removed.     (This  diminished  effect  is 
largely  due  to  the  correlations  between  CDA  measures  and 
classroom  composition  measures.)     Thus  it  apears  difficult 
to  separate  out  the  effects  of  the  CDA  ratings  and  classroom 
composition  measures  upon  PSI  gains. 

The  relationship  between  CDA  ratings  and  PPVT 
gain  scores  was  a  much  stronger  one.     All  but  five  of  the 
CDA  constructs  were  significantly  correlated  with  PPVT  GAIN 
before  policy  variables  were  considered.     Controlling  for 
PREVIOUS  DAY  CARE  EXPERIENCE   (or  PREVIOUS  DAY  CARE  EXPERIENCE 
GROUP  SIZE  and  STAFF/CHILD  RATIO)  diminished  relationships, 
especially  for  CHILD  ORIENTATION.     Nonetheless,  a  number  of 
significant  partial  correlations  remained. 

Regression  results  (Tables  A. 27  and  A. 28,  Appen- 
dix A)   indicated  that  the  CDA  variables  were  not  strong 
predictors  of  PSI  gain  scores  but  that  the  overall  CDA 
rating  was  a  better  predictor  of  PPVT  gains  than  were  any  of 
the  policy  or  process  variables.     Its  significance,  however, 
was  greatly  reduced  if  PREVIOUS  DAY  CARE  EXPERIENCE  was 
first  entered  into  the  regression  model.     Examining  the 
regression  coefficients,  it  is  clear  that  the  two  variables 
are  multi-collinear  and  that  their  effects  can  not  be 
separated.     The  evidence  suggests,  however,  that  caregivers 
Who  work  well  with  children,  who  have  had  experience  working 


481 


504 


with  children  in  other  day  care  settings  and  who  direct 
their  attention  to  the  needs  of  the  children  are  associated 
with  higher  PPVT  gain  scores,  but  not  necessarily  with 
higher  PSI  gain  scores. 
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CHAPTER  SIX!  CONCLUSIONS 


The  analyses  reported  above,  which  are  based  on 
data  for  approximately  260  children  in  eight  Atlanta  Public 
Schools  day  care  centers,  have  highlighted  several  relation- 
ships between  classroom  composition  and  caregiver  qualifica- 
tions, adult  and  child  behaviors,  and  children's  acquisition 
of  skills  and  knowledge  as  measured  by  the  PSI  and  PPVT 
Most  important,  these  results  reaffirm  the  theory  that 
classrooms  in  which  small  numbers  of  children  and  caregivers 
interact.  With  each  other  are  associated  with  better  care  for 
children.     Moreover,  several  aspects  of  caregiver  qualifica- 
tions, most  notably  previous  day  care  experience,  are  not 
only  related  to  the  degree  of  caregiver  interactiveness  but 
are  also  associated  with  higher  cognitive  gain  scores. 

In  addition  to  these  broad  results,  the  replication 
analysis  in  the  Atlanta  Public  Schools  suggests  that  a 
distinction  should  be  made  between  teachers  and  aides,  m 
the  APS  study,  aides  and  lead  teachers  behaved  differently 
and  were  differentially  affected  by  variations  in  classroom 
composition.     Although  on  the  surface  this  result  may  not  be 
surprising,  it  helps  to  provide  insight  into  classroom 
dynamics  and  perceived  job  roles.    For  example,  the  APS 
aides  were  much  more  interactive  in  smaller  classes  with 
higher  ratios;  when  the  classes  were  too  large  and  the  ratio 
was  lower,  the  aides  tended  to  observe  classroom  activities. 
On  the  other  hand,  llad  teacher  behavior  was  not  signifi- 
cantly influenced  by  these  variations;  the  APS  lead  teachers 
appeared  to  cope  with  larger  groups  in  much  the  same  manner 
as  they  did  with  smaller  ones. 

The  amount  of  previous  day  care  experience  a 
caregiver  had  also  appeared  to  be  a  key  determinant  of 
better  care  for  children.     Caregivers  with  more  experience 
tended  to  be  more  interactive  and  to  receive  higher  CDA 


483 

596 


ratings?  moreover,  they  were  able  to  keep  children  actively 
involved  in  classroom  activities.    This  active  integration 
into  the  classroom  is  reflected  in  higher  PPVT  gain  scores. 
Thus,  it  appears  that  more  experienced  caregivers  are 
better  equipped  to  manage  a  classroom  well  and  to  facilitate 
those  environments  that  are  associated  with  better  child 
care. 

It  is  important  to  note  that,  except  for  the 
findings  for  aides,  the  results  reported  here  parallel  those 
found  in  the  57-center  study.     Both  studies  indicate  that  a 
small-scale  classroom  environment  and  skilled,  experienced 
caregivers  benefit  children  in  day  care.     However,  in  the 
APS  study,  which  had  little  variation  in  specialization, 
caregiver  quality  is  reflected  in  the  variable  PREVIOUS  DAY 
CARE  EXPERIENCE,  while  in  the  overall  study,  in  which  there 
was  little  variation  in  previous  day  care  experience,  the 
variable  SPECIALIZATION  appears  to  be  associated  with 
caregiver  quality.     Thus,  there  is  some  evidence  that 
caregivers  who  have  a  continuing  interest  in  day  care  and 
children,  which  is  reflected  in  their  either  seeking  new 
jobs  in  the  field  or* obtaining  intensive,  specialized 
preparation  related  to  day  care,  provide  a  btter  environment 
in  which  young  children  can  thrive. 
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APPENDIX  A 


79bU  A.l 

POUCY  VARIABLE/PSI  GAIN  SPORE  REGRESSION  RESULTS 
CHILD  LEVEL  VS.  CLASS  LEVEL 

Child  Level  aass  Level 


Independent 
Variable 

r 

B 

(t^265) 

F 

r2 

r 

E 

J5l 

(1^30) 
F 

^F 

r2 

Years  of  Education 

.07 

.323 

.267 

1.47 

.22 

.01 

1  .14 

.339 

.446 

.53 

.52 

.02 

Staff/Qiild  Ratio 

.21 

28.324 

8.336 

11.54 

.001 

.04 

I  .37 

28.759 

13.915 

4.27 

.05 

.13 

Group  Size 

-.35 

-.310  . 

.051 

37.01 

.000 

.12 

1  -.62 

-.310 

.074 

17.30 

.01 

.38 

NuDber  of  Caregivers 

-.10 

-.561 

.350 

2.56 

.11 

.01 

1  -.17 

-.565 

.609 

.86 

.64 

.03 

Center  Experience 

.02 

.068 

.197 

.12 

.73 

.00 

1  .03 

.060 

.344 

.03 

.86 

.00 

Previous  Day  Care 
&qperience 

-.002 

(not  calculatable; 

1  .009 

(not  calculatable) 

^ecialization 

.08 

2.067 

1.540 

1.80 

.18 

.01 

1      .15  . 

2.103 

2.659 

.62 

.56 

.02 

Level  of  Education 

.05 

.316 

.354 

.80 

.62  • 

.00 

I  .08 

.255 

.572 

.20 

.66 

.01 

Group  Size 
Staff/Qiild  Ratio 

-.35 
.21 

-.288 
20.973 

.051 
7.996 

31.82 
6.88 

.000 
.009 

.15 

]  -.62 
1  .37 

-.287 
20.982 

.073 
11.449 

15.62 
3.36 

-.00 
.075 

.45 

Group  Size 
Center  Experience 

-.35 
.02 

-.343 
.421 

.053 
.191 

42.30 
4.89 

.000 
.03 

.14 

1  .03 

-.342 
.415 

.976 
.276 

20.28 
2.25 

.00 
-.13 

.43 

Group  Size 
Previous  Day  Care 
Experience 

-.35 
-.002 

-.349 
-.692 

.054 
.314 

42.41 
4.86 

.000 
.03. 

.14 

1  -.62 
1  -.009 

-.349 
-.706 

.077 
.456 

20.57 
2.40 

.00 
.13 

.43 

Group  Size 
S^ialization 

-.35 
.08 

-.314 
2.537 

.051 
1.443 

88.33 
3.09 

.000 
.08 

.13 

1  -.62 
1  .14 

-.314 
2.545 

.974 
2.099 

18.06 
1.47 

.00 
.23 

.41 

Group  Size 

years  of  Education 

-.35 
.07 

-.306 
.173 

.051 
.252 

35.74 
.47 

.000 
.50 

.13 

I  -.62 
1  .14 

-.306 
.180 

.076 
.377 

16.24 
0.23 

.00 
.64 

.39 

Group  Size 
Cmter  Experience 
Previous  Day  Care 
Experience 

-.35 
.02 
-.002 

-.395 
.499 
-.819 

.056 
.191 
.314 

50.03 
6.82 
6.79 

.000 
.009 
.01 

.16 

1  -.62 
1  .03 
1  .009 

-.395 
.496 
.837 

.078 
•267 
.442 

25.80 
3.44 
3.58 

.00 
.07 
.07 

.50 

Group  Size 
Staff/Qiild  Ratio 
Specialization 

-.35 
.21 
.08 

-.290 
25.486 
3.571 

.051 
8.132 
1.457 

32.86 
9.82 
6.01 

.000 
.002 
.01 

.17 

1  -.62 
I  .37 
]  .15 

-.288 
25.536 
3.571 

.070 
11.310 
2.008 

17.02 
5.10 
3.16 

.001 

.03 

.08 

•51 

Group  Size 
Staff/Qiild  Ratio 
Level  of  Education 

-.35 
.21 
.05 

-.283 
21.723 
.215 

.052 
8.090 
.334 

30.17 
7.21 
.41 

.000 
.008 
.53 

.15 

1  -.62 
1  .37 
1  .08 

-.282 
11.814- 
.449 

.074 
3.664 
.459 

14.60 

.00 
.07 
.51 

.46 
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Xnd«pmd«it 

Variabl*  ^ 

VMn  of  Education  .04 

Staff/Child  Ratio  .06 

Group  siza  -.o9 

Mabar  of  caragivars  -.05 

Cantar  &cpariancc  .04 


B 

.410 
-18.354 

-  .164 

-  .577 
.284 


l^ble  A.2 

POUCy-VARIARrj;>^pyT  GA^^           Pmppgcrcys  RESULTS 
QilLD  LEVEL  Vt.  CUSSTZgEE  

Child  Lavel 
0»-265) 


Class  Level 


.565 
-18.344 
.117 
.748 
.406 


.53 
1.00 
1.97 
.59 
.49 


.52 
.32 
.16 
.55 
.51 


.01 
.04 
.12 
.01 
.00 


&q)arianca 

.21 

2.315 

.663 

12.19 

.001 

.04 

Spacialiation 

.11 

5.546 

3.181 

3.04 

.08 

.01 

Laval  of  Education 

.08 

.916 

.739 

1.54 

.21 

.01 

Previous  Day  care 
Qcpariance 
Vaars  of  Education 

.21 
.04 

2.300 
.342 

.664 
.554 

11.99 
.02 

.001 
.54 

.05 

Previous  Day  care 
EKpericnce 
Staff/Oiild  Ratio 

.21 
.06 

2.292 
-2.358 

.687 
18.622 

11.12 
.02 

.001 
.89 

.04 

Previous  Day  care 

Experience 
Group  Size 

.21 
-.09 

2.243 
.038 

.702 
.121 

10.21 
.10 

.002 
.75 

.05 

Previous  Day  care 
Experience 
Canter  Experience 

.21 
-.04 

2.349 
-.364 

.664 
.398 

12.51 
.84 

.001 
.64 

.05 

Previous  Day  Care 
ficparience 
Specialization 

.21 
-.11 

2.183 
3.922 

.671 
3.163 

10.60 
1.54 

.002 
.21 

.05 

Previous  Day  care 
Experience 
Canter  Experience 
Slpecialization 

.21 
-.04 
.01 

2.198 
-.518 
4.947 

.670 
.410 
3.261 

10.76 
2.30 
1.60 

.002 

.13 

.20 

.06 

Previous  Day  care 
&q)erience 
Cantar  Experience 
Years  of  Education 

.21 
-.04 
.04 

2.335 
-.351 
.314 

.666 
.399 
.555 

12.30 
.77 
.32 

.001 

.62 

.58 

.05 

Previous  Day  care 
ficpateince 
Level  bt  Education 

.21 
.08 

2.279 
.793 

.664 
.725 

11.80 
1.20 

.001 
.27 

.05 

Previous  Day  care 
Experience 
Level  of  Education 
Cantar  Experience 

.21 
.08 
-.04 

2.317 
1.032 
-  .510 

.664 
.749 
.411 

12.19 
1.90 
1.54 

.001 

.17 

.21 

.05 

r 

B 

(W-30) 
F 

r2 

.14 

.504 

.711 

.501 

.47 

.02 

.37  -17.679 

23.014 

4.596 

.04 

.02 

-.62 

-.180 

.144 

1.538 

.22 

.05 

-.17 

-.631 

.45 

.51 

.02 

.03 

-.315 

•509 

.38 

.54 

.01 

.51 

2.306 

.740 

9.72 

.00 

.26 

.26 

5.499 

3.939 

1.95 

.17 

.07 

.25 

1.160 

.838 

1.92 

.17 

.06 

.51 
.25 

2.291 
.450 

9.746 
.624 

9.42 
.05 

.01 
.82 

.27 

(not  calculatoble) 

i 


.51 
-.23 


.51 
-.12 


.51 
.26 


'2.199 
.036 


2.344 
-.396 


2.177 
3.868 


.794 
.137 


.744 
.444 


.746 
3.542 


7.67 
.17 


9.94 
.80 


8.51 
1.19 


.51  2.194 
-.12  -.550 
.26  4.965 


.740  8.79 
.451  1.49 
3.624  1.89 


.51 
.12 
.13 


.51 
.25 


2.328 
-.379 
.419 


2.243 
1.020 


.752 
.449 
.628 


.729 
.736 


9.60 
.71 
.44 


9.47 
1.92 


.51  2.284 
.25  1.149 
.12  -.500 


.726  9.90 
.740  2.41 
.438  1.30 


.01 
.69 


.00 
.62 


.01 
.28 


.01 
.23 
.18 


.00 
.59 
.52 


.01 
.17 


.004 

.13 

.26 


.26 


.28 


.33 


.29 


.31 


.34 
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*    Tiblt  A.3 

POUCY  VARIABLE/PSI  GAIN  SCgRE  REGRESSION  RESULTS  -  CHILD  LEVEL 
LOOGg)  VS.  UNLOOGED  CLASS  STWCTORE  VARIABLg 

Uil099«d  Loggad 
Ind#p€ndfnt  . 


Variablt 

r 

B 

F 

R^ 

r 

fi 

F 

R^ 

Group  Siza 

-.39 

-.350 

.055 

40.11 

.000 

.15 

1  -.31 

-11.705 

2.429 

23.23 

.000 

.09 

Group  Sizm 

obOZZ/UllXO  HBClO 

-.39 
.19 

-.335 
20.868 

.005 
8.786 

37.49 
5.64 

.000 
.02 

.17 

1  -.31 
1  .24 

-10.985 
10.230 

2.384 
3.023 

21.23 
11.45 

.000 
.001 

.14 

Group  Si at 
Prtvious  Oiy  Care 
Expcrivscc 

-.39 
•01 

-.388 
-.698 

.058 
.343 

45.46 
4.14 

.000 
.04 

.17 

1  -.31 
1  .01 

-14.744 
-  .910 

2.715 
.379 

29.48 
5.78 

.000 
.02 

.12 

Group  Sizt 
Centtr  Experience 

-.39 
-.01 

-.376 
.343 

.057 
.203 

43.95 
2.85 

.000 
•089 

.16 

1  -.31 
1  -.01 

-12^464 
.248 

2.511 
.210 

24.65 
1.39 

.000 
.24 

.10 

v*&uv|i'  size 
Specialisation 

.05 

—  .J  W 

.655 

1.670 

40.08 
.15 

.000 
.70 

.15 

1        (not  calculatable) 

Group  Size 

StAff /Child  Bjtt-in 

PrcviouB  Day  Care 
Experience 

-.39 

1  Q 

.01 

-.363 
16.438 
-.456 

.059 
9.479 
•369 

38.68 
3.01 
1.53 

.000 
.21 

.18 

1  -.31 
1  .24 
1  .01 

-13.093 
8.862 
-  .603 

2.737 
3.140 
.388 

22.87 
7.96 
2.41 

.000 
.005 
.12 

.15 

Grouc  Civ* 

Previous  Day  Care 
Experience 
Center  Experience 

-.39 
•01. 

-.01 

-.428 
-.845 

.441 

.060 
.347 

.205 

50.80 
5.92 

4.62 

.01 
.03 

1  Q 

I  -.31 
1  -.01 

-16.550 
-  1.088 

.396 

2.872 
.389 

.214 

7.84 
3.43 

.000 
.006 

.06 

Group  Size 
Staff/Qiild  Ratio 
Center  Experience 

-.39 
.19 
-.01 

-.363 
22.160 
.383 

.056 
8.762 
.201 

41.48 
6.40 

3.61 

.000 

.01 

.05 

.19 

1  -.31 
1  .24 
1  -.01 

-11.942 
10.724 
.323 

2.453 
3.030 
.206 

23.70 
12.53 
2.46 

.000 

.00 

.11 

.15 

Group  Size 
Staff/Qiild  Ratio 
Specialization 

-.39 
.19 
.05 

-.329 
23.437 
1.821 

.055 
9.109 
1.710 

35.77 
6.62 
1.13 

.000 
.010 
.29 

.18 

I  -.31 
1  .24 
1  .05 

-10.968 
11.182 
2.716 

2.376 
3.072 
1.709 

21.31 
13.25 
2.52 

.  .000 
.000 
.11 

.15 

Group  Size 
Previous  Day  Care 
Qcperience 
Specializetion 

-.39 
.01 

.51 

-.387 
-.744 

1.274 

.058 
.349 

1.682 

45.26 
4.55 

0.57 

.000 
.032 

.54 

.17 

I  -.31 
1  .01 

1  .05 

-15.192 
-1.031 

2.5C6 

2.727 
.387 

1.740 

31.04 
7.10 

2.07 

.000 
.008 

.15 

.12 

Group  Size 
Center  Experience 
Specialization 

-.39 
-.01 
.05 

(not  calculatable) 

1  -.31 
1  -.01 
I  .05 

-12.382 
•215 
1.051 

2.518 
.218 
1.782 

24.18 
.97 
.35 

.000 

.67 

.56 

.10 

Group  Size 
Staff/Qiild  Ratio 
Years  of  Education 

-.39 
.19 
.05 

(not  calculatable) 

1  -.31 
1  .24 
1  .05 

-10.940 
10.226 
.042 

2.409 
3.030 
.281 

20.63 
11.39 
.02 

.000 
.001 
.88 

.14 

Group  Size 
Center  Experience 
Years  o£  Education 

-.39 
-.01 
.05 

-.375 
.344 
.041 

.057 
.204 
.277 

43.11 
2.85 
.02 

.000 

.09 

.88 

.16 

1  -.31 
1  -.01 
1  .05 

-12.400 
.250 

2.533 
.211 
.288 

23.97 
1.40 
.05 

.000 

.24 

.82 

.10 
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table  A,4 


Independent 

Ui  logged 

Variable 

L 

o 

F 

Group  Size 
Previous  Day  Care 
Experience 

".11 

.23 

-.069 
2.386 

.128 
.765 

.29 
9.74 

.60 
.002 

Group  Size 
Staff/Child  Ratio 
Previous  Day  Care 
Experience 

-.11 
-.08 
.23 

.081 
-7.642 
2.274 

.132 
21.254 
.828 

.31 
.13 

7.55 

.58 
.72 
.006 

Group  Size 
Previous  Day  Care 
Experience 

-.11 
.23 

-.042 
2.483 

.135 
.781 

.10 
10.11 

.76 
.002 

Center  Experience 

-.03 

-.292 

.461 

.04 

.83 

Previous  Day  Care 

Experience 
Staff/Child  Ratio 
Center  Experience 

.23 
-.08 
-.03 

2.504 
-5.789 
-.347 

.766 
20.659 
.439 

10.68 
.08 
.63 

.002 

.76 

.56 

Group  size 
Previous  Day  Care 
Experience 

-.11 
.23 

-.068 
2.253 

.128 
.776 

.28 
8.42 

.60 
.004 

Specialization 

.11 

3.729 

3.745 

.99 

.68 

POLICY  VARIABiyppVI'  GAIN  SOQRR  pp^Drccyo^i  ^ 

(N=>228)   


R' 
.05 

.05 
.05 


.05 


.06 


-.14 
.23 


-3.492 
2.292 


5.867 
.818 


togged 
F 

.35 
7.85 


.14  -3.878  6.018  .41 
.06  -2.072  6.904  .09 
.23     2.220        .954  6.76 


-.14 
.23 

-.03 


-2.207 
2.419 

-.282 


6.247 
.845 

.465 


.12 
8.19 

.37 


.56 
.006 


.53 
.76 
.01 


.72 
.005 

.55 


.23 
-.06 
-.29 

2.534 
-1.695 
-.349 

.743 
6.780 
.440 

11.64 
.06 
.63 

.001 

.57 

.57 

-.14 
.23 

-4.218 
2.097 

5.904 
.838 

.51 
6.27 

.52 
.01 

.11 

4.058 

3.767 

1.16 

.28 
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Table  A.  5 

POUCY  VARIABLE/ADULT  FOCUS  RBGRESSION  RESULTS  -  TEACHERS 


INSTRUCTS 
(N»29) 

r  B 

c 
c 

^F 

Ibtal  Day  Care  Qcperience 

.26 

.006 

.004 

1.98 

.17 

.07 

Nuniser  o£  Caregivers 

-.08 

-.005 

.011 

.a 

.65 

Education  Level 

.15 

.007 

.010 

.OU 

•  lU 

Tbtal  Day  Care  Qcperience 

.26 

.006 

.004 

2.01 

.17 

Staff/Child  Ratio 

-.20 

.140 

.154 

.82 

.62 

.10 

Total  Day  Care  ^perience 

.26 

.005 

.004 

1.70 

.20 

Staff/Child  Ratio 

-.20 

-.197 

.161 

1.49 

.23 

.14 

Education  Level 

.15 

.011 

.010 

1.32 

.26 

Ibtal  Day  Care  Experience 

.26 

.005 

.UU4 

ADULT  ACTIVITY 

(N=29) 

r 

B 

F 

Nuinber  of  Caregivers 

-.36 

-.oa 

.UlU 

4.U  / 

.X  J 

Staff/Child  Ratio 

-.32 

-.273 

.154 

3.13 

.08 

.10 

Education  Level 

-.15 

-.008 

.UlU 

t^A 
.04 

.DO 

Group  Size 

.001 

-.002 

.002 

.75 

.60 

.13 

-.32 

-.339 

.1.  /  J 

.06 

Group  Size 

.001 

-.002 

.002 

.82 

.62 

.14 

-.32 

-.335 

»±  /  D 

•J  . 

Ibtal  Day  Care  ^perience 

.11 

.002 

.004 

.27 

.61 

Nunber  of  Caregivers 

-.36 

-.022 

.011 

4.20 

.05 

.16 

Education  Level 

-.15 

-.009 

.009 

.87 

.64 

Number  of  Caregivers 

-.36 

-.022 

.011 

4.30 

.05 

.18 

Itotal  Day  Care  Qcperience 

.11 

.003 

.004 

.83 

.63 

-.009 

.009 

.53 

.52 

Staff/Child  Ratio 

-.32 

-.151 

.182 

.68 

.58 

.15 

Number  of  Caregivers 

-.36 

-.015 

.013 

1.52 

.23 

Staff/Child  Ratio 

-.32 

-.266 

.167 

2.85 

.10 

.11 

Tbtal  Day  Care  ^perience 

-.15 

.002 

.004 

.18 

.68 

Staff/Child  Ratio 

-.32 

.132 

.187 

.50 

.51 

.17 

Number  of  Caregivers 

-.36 

-.017 

.013 

1.67 

.21 

Itotal  Day  Care  Qcperience 

.11 

.003 

.004 

.37 

.56 
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Table  A. 5  (cont'd) 
COTTER  ACnVITV 


(N»29) 


Education  Level 

Nijfnber  of  Caregivers 
Education  Level 

Nimber  of  Caregivers 
Obtal  Day  Care  Experience 
Education  Level 

Staff/Child  Ratio 
Education  Level 

Staff/Child  Ratio 

Education  Level 

Itotal  toy  Care  Experience 

Without  Directors  (N«21) 

Staff /Child  Ratio 

Staff/Child  Ratio 

Ibtal  Day  Care  Experience 

Staff/Child  Ratio 
Cfenter  Experience 
Previous  Day  Care 
Experience 


r 

B 

F 

.41 

.058 

.024 

5.66 

.14 
.41 

.025 
.058 

.028 
.025 

.79 
5.55 

.14 
.14 
.41 

.023 
.009 
.058 

.028 
.011 
.025 

.69 
.63 
5.53 

.38 
.41 

.647 
.046 

.404 
.025 

2.57 
3.45 

.38 
.41 
.14 

.695 
.044 
.011 

.409 
.025 
.010 

2.89 
3.06 
1.10 

•  48 

1.25 

.52 

5.79 

.48 
.35 

1.39 
.021 

.47 
.009 

8.58 
5.24 

.48 
.16 

1.64 
.020 

.49 
.010 

7.68 
4.20 

.23 

.024 

.014 

3.11 

493 


5li 


Ttole  A.5  (cont'd) 


OBSERVE 
(N»29} 


r 

B 

s^- 

F 

^F 

R 

Education  Level 

-.054 

.022 

5.74 

.02 

.18 

Group  Size 

•  40 

.006 

.004 

3.00 

.09 

.26 

Education  Level 

-.40 

-.043 

.023 

3.60 

.07 

Number  of  Caregivers 

.11 

.018 

.025 

.51 

.51 

.19 

Education  Level 

-.40 

-.054 

.023 

5.74 

.02 

Nuinber  of  Caregivers 

.11 

.015 

.026 

.31 

.59 

.18 

Total  Day  Care  Qeperience 

-.08 

-.005 

.010 

.24 

.63 

Education  Level 

-.40 

-.052 

.023 

4.89 

.03 

Group  Size 

.40 

.008 

.004 

3.37 

.07 

.27 

Education  Level 

-.40 

-.046 

.023 

3.88 

.06 

stact/cniid  Ratio 

-.14 

.267 

.405 

.44 

.52 

Staf^Child  Ratio 

-.14 

-.262 

.471 

.30 

.59 

.20 

Education  Level 

-.40 

-.050 

.024 

4.16 

.05 

Number  of  Caregivers 

.11 

.028 

.031 

.OU 

MANftSEMENT  BEHAVIOR 

(N«29) 

r 

B 

F 

^F 

r2 

Education  Level 

-.19 

-.013 

.013 

1.06 

.31 

.04 

Number  of  Caregivers 

.15 

.013 

.015 

.72 

.59 

.09 

Total  Day  Care  Qcperience 

-.16 

-.005 

.006 

.66 

.57 

Education  Level 

-.19 

-.013 

.013 

.98 

.67 

Group  Size 

.15 

.002 

.002 

.44 

.52 

.08 

Education  Level 

-.19 

-.010 

.014 

.52 

.52 

Total  Day  Care  ^perience 

-.16 

-.005 

.006 

.74 

.60 

Education  Level 

-.19 

-.013 

.013 

.94 

.66 

.06 

Total  Day  Care  £}cperience 

-.16 

-.004 

.006 

.59 

.55 

5?  J 
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Group  Size 

Number  of  Caregivers 

Staf^/Child  Ratio 

Group  Size 
Staff/Child  Ratio 

Number  of  Caregivers 
Education  Level 

Number  of  Caregivers 
Total  E5y-Care  Experience 
Education  Level 

Group  Size 
Education  Level 
Staff/Child  Ratio 

Staft/Child  Ratio 
Education  Level 
Number  of  Caregivers 


Table  A. 5  (cont'd) 

SOCIAL  INTERACTION 
(N«29) 


r 

B 

SE^ 

-.21 

-.003 

.003 

-.027 

.017 

-.21 

-.271 

.248 

-.21 
-.21 

-.005 
-.490 

.003 
.265 

-.30 
.20 

-.028 
.018 

.017 
.015 

-.30 
-.06 
.20 

-.027 
-.001 
.014 

.017 
.007 
.014 

-.21 
.20 
-.21 

-.004 
.020 
-.559 

.003 
.015 
.268 

-.21 
.20 
-.30 

-.215 
.021 
-.020 

.307 
.016 
.020 

F 



F 

r2 

1.24 

.27 

.04 

0  7n 
^.  f\j 

.11 

.09 

1.19 

.28 

.04 

3.47 

.07 

.16 

3.42 

.07 

2.87 

.10 

.14 

1.41 

.24 

2.41 

.13 

.13 

.03 

.85 

.96 

.66 

1.68 

.20 

.21 

1.60 

.22 

1.60 

.22 

.49 

.50 

.15 

1.80 

.19 

.99 

.67 
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Tible  A.  6 

POUCy  VARIABLE/ADULT  FOCUS  RBSRESSIOM  RESULTS  -  AIDES 


INSroUCTS 
(N«21) 


r 

B 

D 

F 

r 

r2 

•  D  f 

.UU4 

Q   1  ^ 
7.  ID 

.UU7 

NuBnber  of  Caregivers 

-.16 

-.020 

.028 

.51 

.51 

.03 

staff /Child  R»t-{n 

wAiXXU  nflw^w 

.  300 

•  H\J± 

Am  10 

.10 

in 

Number  of  Caregivers 

-.16 

-.091 

.031 

8.39 

.009 

.39 

Staff/Child  Ratio 

.32 

1.547 

.475 

10.61 

.004 

Group  Size 

-.57 

-.011 

.004 

9.02 

.008 

.33 

Total  Day  Care  Experience 

.01 

.003 

.005 

.28 

.61 

Nunber  of  Caregivers 

-.16 

-.021 

.029 

.53 

.52 

.03 

Total  Day  Care  Qcperience 

.001 

.006 

.05 

.83 

Number  of  Caregivers 

-.16 

-.095 

.033 

8.29 

.01 

.40 

Total  Day  Care  Experience 

.01 

.003 

.005 

.26 

.62 

Staff/Child  Ratio 

.32 

1.566  - 

.486 

10.37 

.005 

Staff/Child  Ratio 

.32 

.585 

.412 

2.20 

.17 

.10 

Education  Level 

.05 

.005 

.032 

.02 

.87 

Group  Size 

-.57 

-.012 

.004 

8.7 

.009 

.34 

Education  Level 

.05 

-.012 

.029 

.2 

.64 

Total  Day  Care  Qcperience 

.01 

.003 

.005 

.20 

.68 

Staff/Child  Ratio 

.32 

.592 

.427 

1.9 

.18 

.10 

Education  Level 

.05 

.005 

.033 

.0 

.88 

Total  Day  Care  Qcperience 

.01 

-.001 

.006 

.0 

.89 
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Table  A.6  (cont'd) 
ADULT  ACTIVITY 


Group  Size 

Number  of  Caregivers 

Staff/Child  Ratio 

Group  Size 

Level  of  Education 

Group  Size 

Day  Care  Qcperience 

Number  of  Caregivers 
Staff/Child  Ratio 

Number  of  Caregivers 
I>ay  Care  Experience 
Staff/Child  Ratio 

Staff/Child  Ratio 
Group  Size 

Staff/Child  Ratio 
I>ay  Care  Experience 

Group  Size 
Education  Level 
IJay  Care  Eicperience 

Staff/Child  Ratio 

Group  Size 

Day  Care  Experience 


r 

B 

F 

h 

r2 

.43 

.007 

.003 

4.20 

.05 

.18 

-.16 

-  .017 

.023 

.52 

.  HO 

.Oj 

-.47 

-  .722 

.308 

5.48 

.03 

.22 

.43 
-.01 

.007 
.010 

.003 
.026 

4.16 
.15 

.06 
.70 

.19 

.43 
-.12 

-  .021 
.004 

.024 
.005 

.76 
.51 

.39 
.48 

m\JD 

-.16 
-.47 

-  .033 
1.067 

.028 
.426 

1.34 

.26 

.02 

.28 

-.16 
.12 
-.47 

.028 
.003 
-1.046 

.030 
.005 
.435 

.92 
.38 
5.77 

.35 
.55 
.03 

.29 

-.47 
.43 

-  .536 
.004 

.345 
.004 

2.41 
1.34 

.14 
.26 

.28 

-.47 
.12 

-  .756 
.004 

.313 
.004 

5.84 
.75 

.03 
.40 

.25 

.43 
-.01 
.12 

-  .807 
.010 
.001 

•  003 
.026 
.005 

3.72 
.15 
.06 

.07 
•  71 
.81 

.19 

-.47 
.<  .> 
.10 

-  .585 
.004 
.003 

.360 
.004 
.005 

2.64 
.92 

•  38 

.12 
.35 
.55 

.29 
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Table  A.6  (cont'd) 


MANAGEMENT  BEHAVia^ 
(N«21) 


r 

B 

D 

F 

r 

r2 

Group  Size 



-.48 



-.008 

.003 

5.62 

\ 

k 

.23 

Group  Size 

-.48 

-.007 

•  003 

5. 07 

.03 

.38 

Total  Day  Care  EScperience 

-.50 

-.010 

.005 

4.38 

.05 

Group  Size 

-.48 

-.010 

.003 

9.30 

.007 

.49 

ToteQ  Day  Care  Experience 

-.50 

-.009 

.005 

3.80 

.06 

Staff/Child  Ratio 

-.12 

-.624 

.322 

3.75 

.07 

Total  Day  Care  Experience 

-.50 

-.012 

.005 

6.41 

.02 

.25 

Number  of  Caregivers 

-.48 

-.041  . 

.021 

3.87 

•06 

.38 

Total  Day  Care  Experience 

-.  50 

.010 

.004 

4.52 

.04 

Group  Size 

-.48 

-.007 

.003 

5.14 

.03 

•  42 

Total  Day  Care  Experience 

-.50 

-.010 

.004 

5.88 

.02 

Number  of  Caregivers 

-.48 

-.039 

.020 

3.93 

.06 

.48 

Total  Day  Care  Ebcperience 

-.50 

-.009 

.004  ' 

4.95 

.04 

Education  Level 

.35 

.040 

.022 

3.29 

.08 

m  HO 

.  UHJL 

.  JO 

Total  Day  Care  Experience 

-.50 

.010 

.004 

4.52 

.04 

Staff/Child  Ratio 

-.12 

.564 

.32 

3.07 

.09 

.51 

Total  Day  Care  Experience 

-.50 

-.009 

.004 

4.46 

.05 

Group  Size 

-.48 

-.010 

.003 

8.69 

.009 

Group  Size 

-.48 

-.006 

.003 

3.84 

.06 

.48 

Education  Level 

.35 

.032 

.022 

2.09 

.16 

Total  Day  Care  Ebcperience 

-.50 

-.010 

.004 

6.23 

.02 

Staff/Child  Ratio 

-.12 

-.118 

.317 

•  14 

.71 

.37 

Education  Level 

.35 

.042 

.024 

3.09 

.09 

Total  Day  Care  Ebcperience 

-.50 

-.011 

•  005 

6.16 

.02 

Education  Level 

.35 

.042 

.024 

3. 20 

•  09 

•36 

Total  Day  Care  Qcperience 

-.50 

-.011 

•  004 

6.82 

.02 

521 
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Table  A.6  {cont'd) 

SCXriAL  INTERACnCN 
{N=21) 


r 

B 

F 

r2 

Group  Size 

-.76 

-•021 

•004 

25^55 

•  000 

•  57 

Staff/Child  Katio 

•44 

1^173 

•  552 

4^51 

•  04 

•  19 

Education  Level 

.30 

•062 

•  045 

1^87 

•18 

•  09 

Group  Size 
Education  Level 

-.76 
.30 

-•020 
•  028 

•  004 

•  032 

22^12 
•79 

•  000 
•61 

•  59 

Number  of  Caregivers 

A  A 

•  44 
-.15 

2.889 
-•158 

•  557 
•037 

26^00 
18^41 

•  000 

•  001 

•60 

Staf^/Child  Ratio 
NuBsber  of  Caregivers 
Education  Level 

.44 
-•15 
.30 

2^753 
-•152 
•  432 

•  544 
•036 
•030 

25^59 
17^70 
2^7 

•  002 

•  001 
•17 

•64 

Staff/Child  Ratio 
Education  Level 

•44 
•30 

1^15 
-•059 

•  54 

•  041 

4^54 
2^01 

•  04 

•  17 

•27 

Group  Size 

Education  Level 

Ibtal  Day  Care  Eicperience 

-•76 
•30 
-•16 

-•020 
•  028 
-•002 

•  004 

•  033 

•  006 

20^16 
•75 
•10 

•  001 
•60 

•  75 

•  59 

Staff/Child  Ratio 

Education  Level 

TDtal  Day  Care  Ebcperience 

•44 
•  30 
-•16 

1^217 
•  057 
-•008 

•  542 

•  041 

•  008 

5^04 
1^90 
1^06 

•  04 
•18 

•  32 

•32 

Education  Level 

Ibtal  Day  Care  Experience 

.30 
-•16 

•  061 
-•006 

•046 
•  009 

1^75 
•  46 

•  20 

•  51 

.11 

5^9 
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Table  A. 7 


STEW>ANI>>LEAF  DISPLAYS  OF  ADULT  FOCUS 
VARIABLES  BY  LEVEL  OF  EDUCATION  

INSTRUCTS 

HS 

I   2  0  .00-.03   11  0  3  2  3  3 


I 

.03-. 06   16  5  5  5  4 


I 

03-. 64   14  5  3  5  3  4  5 

.06-. 09   17  6  8  7  6  8  9  .06-. 09   |  9  7  7 

10  9  2  .09-. 12   I  2  1 


I 

.12-. 15   14  2  4 

I 

. .15-. 18    I  8 
I 

.18-. 21   I  2 

•^^-•2^   I   2  .21-. 24  I 

.24-. 27  I 

I 

.27-. 30  I 
I 


I 

.12-. 15   13  4  3 
I 

.15-. 18  I 

I 

.18-. 21  I 

I 


I 

.24-. 27  I 

I 

.27-. 30   I  9 

I 


ADULT  ACTIVITY 
^  HS 

.00-. 02   10  0  0  0  110  0  0  0  0  1  .00-. 02   1110  2  10  0  0 

I   '  .02-.04   I   3  4  3 

I   '  '  .04-.06   j  4 

.06-. 08   16  7 

i  °  9  °  .08-.10   I   8  0 

.10-. 12  I 

I 

.12-. 14   I  3 


I 

.06-. 08   18  7  6  7  7  6 


.14-. 16  I 


.10-. 12  I 

I 

.12-. 14   I  3 

I 


.16-. 18  I 


j  .14-. 16  I 


I 

.16-. 18  I 

I 

.18-. 20  I 


.18-. 20  I 

I   0  .20-. 22   I  0 


Table  A. 7  (cont'd) 


CENTER  ACTIVITY 

AAT 


.05-. 10  I 

I 


I 


I 


HS 


.00-. 05  I 

I  .00-. 05   I  4 


.05-. 10  I 


•"-^^  I  '  '  .10-  .isl 

.15-. 20   19  ,r     -.^  ! 


.15r.20   I  8 


20-. 25  10  0  on  ! 


I 

.25-. 30  17  8  8  8  8  9 

I  , 
.30-. 35  10 


.20-. 25   I   1  2 

I 

.25-. 30   19  8  6  7 


35-. 40   18  6  8  ,c  ! 


30-. 35   12  4  5  111 


35-. 40   I  7 


\   ''''  .40-.45   15  1  3  0 


.45-. 50   16  6  7  cn  o 

I  .45-. 50    I  8 

.50-. 55   I  ) 


.50-. 55   I  4 


.55-. 60   I  cc     ^  ! 


55-. 60  I 


.60-. 65   I  ^  ' 

.60-. 65   I  4 


OBSERVES 

AAT 


.20-. 30  123845233 


HS 


.00-. LO   I  8 

j  .00-. 10  I 

.10-. 20   j  7  9  6  4  2  3  7  .m.  on  ! 


10-. 20   13  7  9  9 
I 


i       -  «  •*  ^  ^  J  J  .20-. 30  145033642 

.30-. 40   16  8  4  0  n«  ' 

I  "  .30-. 40  18  0  13  6  1 

.40-. 50   16  2  ' 

I       ^  .40-. 50  I   2  2  X 

.50-. 60    I  r«     ^  ' 

I  .50-. 60  I  2 

.60-. 70   I  ^«     ^  ' 

I  .60-. 70  I 

•70-. 80   I  I 

.70-. 80  I  8 

I 
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Table  A,7  (cont'd) 
MANAGEMENT  BEHAVIOR 


AAT 

HS 

.00-. 05 

.00-. 05  1 

4 

.05-. 10 

1  8 

.05-. 10  1 

9 

6 

8 

7 

.10-. 15 

1  1 

2 

0 

3 

4  2  0  2 

.10-  .151 

4 

2 

5 

1 

2 

0 

.15-. 20 

1  0 

7 

9 

6 

0  7 

•15-. 20  1 

6 

6 

.20-. 25 

1  3 

2 

0 

2 

1  1 

•20-,25  1 

0 

0 

0 

0 

1 

1 

•25-. 30 

•25-,30  1 

.30-. 35 

1  0 

•30-^35  1 

SOCIAL  INTERACTION 

AAT 

HS 

•00-. 15 

•00-. 05  1 

2 

.05-.10 

•05-^10  1 

9 

Q 

7 

Q 

U 

.10-. 15 

1  4 

4 

3 

.10-. 15  1 

0 

1 

3 

0 

2 

3 

•15-. 20 

1  9 

0 

5 

6 

0 

.15-^.20  i 

9 

0 

0 

•20-. 25 

t  2 

2 

3 

1 

3  3 

.20-. 25  1 

1 

3 

3 

2 

3 

.30-. 35 

1  6 

8 

7 

7 

5  8 

.30-^34  1 

8 

.35-. 40 

1  1 

.35-. 40  1 

.40-. 45 

1  8 

•40-. 45  1 

.45-50 

•45-. 50  1 

8 

5.'?J 
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Table  A. 8 


STEM-AND-LEAF  DISPLAYS  OP  ADULT  POPiis 
VARIABLES  BY  JOB  ROLE  • 


INSTRUCTS 


Teachers 


00-. 03  110  3  3 
I 

03-. 06  155445345 
I 

D6-.09  17  8  8  9  8  7 

I 

D9-.12  I   110  9  2  2  1 
I 

12-. 15   12  4  2  4  4 
I 

L5-.18  I 
I 

L8-.21  I 
I 

J1-.24  I 
I 

!4-.27  I 
I 

I7-.30  I 


Aides 

.00-. 03   12  10  3  2 
I 

.03-. 06   16  5  5  4  6 
I 

.06-. 09   I   7  6  7  6  9  7  8 
I 

.09-. 12  I 

I 

.12-. 15   I   3  4 

I 

.15-. 18   I  8 

I 

.18-. 21  I 

I 

.21-. 24   I  2 

I 

.24-. 27  I 

I 

.27-. 30   I  9 


ADULT  ACTIVITY 


Teachers 


0-  .02  lOOllOlOOOOl 

2-. 14   I   4  3 
I 

4-. 06   14  4  6  4 

I 

6-. 08   18  7  6  6  7 
I 

B-.IO   10  9  8  8  0  9  3 

I 

D-.12  I 
I 

2-. 14   I   3  3 

I 

J-.16  I 
I 

)-.18  I 
I 

1-  .20  I 

I 

I-.22  I 
I 


.00- 
.02- 
.04- 
.06- 
.08- 
.10- 
.12- 
.14- 
.16- 
.18- 
.20- 


Aldes 

.02   j  121000000100 

.04   I   4  4  3 
I 

.06  I 

I 

.08   I   7  7  7  6 


.10   I  0 
I 

.12  I 

I 

.14  I 

I 

.16  I 

I 

.18  I 

I 

.20  I 

I 

.22   I   0  0 
I 


505 


526 


Table  A. 8  (cont'd) 
CENTER  ACTIVITY 


Teachers 


Aides 


•  UO- .05 

.00-. 05 

4 

m UD— • lU 

.05-. 10 

• lU— • ID 

4 

.10-. 15 

4 

• ID— •Zu 

.15-. 20 

8 

9 

.20-. 25 

1 

2 

.20-. 25 

0 

0 

.25-. 30 

7 

8 

9 

6 

.25-. 30 

7 

8 

8 

.30-. 35 

1 

1 

1 

0 

.30-. 35 

2 

4 

5 

.35-.40 

8 

7 

6 

6 

8 

.35-. 40 

.40-. 45 

r 

0 

1 

3 

0  4  0 

.40-. 45 

2 

0 

5 

.45-. 50 

7 

6 

7 

.45-. 50 

6 

8 

.50-. 55 

4 

3 

4 

.50-. 55 

.55-. 60 

.55-. 60 

.60-. 65 

4 

.50-„65  1 

4 

OBSERVES 


Teachers 


.00-. 10 
.10-. 20 
.20-. 30 
.30-. 40 
.40-. 50 
.50-. 60 
.60-. 70 
.70-. 80 


6  8 

0261296423799 

6  2  3  3  3  6  4 

7  0  1  3  6  1 
2  2 


Aides 


.00-. 10 
.10-. 20 
.20-. 30 
.30-. 4U 
.40-. 50 
.50-. 60 
*.$0-.70 
.7^0-^80 


506 


7  3  7 

2  3  8  4  5 

6  8  4  8 

G  ?  . 
2 


4  5  0  2 


EKLC 


Table  A. 8  (cont'd) 
MANAGEMENT  BEHAVIOR 


Teachers 


Aides 


I  .00-.05  j  4 

.05-. 10   15  8  9  5 

I 


I 

05-. 10   16  8  7 


.10-.15  114  12  2  5  12  112  11     .10-. 15  13  2  4  2  0  0  2  3 

•'=-•2°  I   0  7  6  5  9  .15.. 20  |'  6  o  7  6 

.20..25  j   3  0  4  1  2  0  0  2  .20-. 25  I  0  1  H  o 

.25-. 30  I 


I 

.30-. 35  I 


I 

.25-. 30  I 

I 

.30-. 35   I  0 


Teachers 


SOCIAL  INTERACTION 

Aides 


I  1  .00-.05   I  2 


I 

.15-. 10   17  9  0 

I 

.10-. 15   13  4  0  2  3 
15-. 20   10  8  9  0  5  9  0  .15..20   \  e  00 


.05-. 10   I   9  9 

•  I 

.10-. 15   12  2  4  10  3 


I 

.20-. 25   12  12  2  13  3 


I 

.20-. 25   13  3  13  2  3 
[8  6  8  7  7  8  .25-.30   |  8  5 


I 

.30-. 35   I   3  1 


.35-. 40 
.40-. 45 


I 


I 

.30-. 35  I 
I 

.35-. 40   I  8 
I 

.40-. 45  I 


I  .45-.50   I  8 


507 


528 


Tabl*  A. 9 

SCHEMATIC  PLOTS  OF  ADULT  FOCUS  VARIABLES 


INSTRUCTS 


Teachers 


,35 


.30 


.25 


.20 


.15 


.10 


.05 


Aides 


•  11503 


•  13501 


13404 


T 


I  I 
I  I 

I  AAT  I 
 1  

 I 


5.?,:; 


508 


ERIC 


Table  A. 9  (cont'd) 


ADULT  ACTIVITY 


Teachers 


10903 


Aides 


•  10904 


509 


53 


0 


ERIC 


•  5 


.4 


.3 


.2 


Tablt  A. 9  (cont'd) 

CENTER  ACTIVITY 

Teachers 

1 

Aides 

1                •  13505 
1  1 

1  1 

1  1 

1 
1 

1     MA     1    1               1  ' 
1             II  1 
1             II  1 

-j- 

1 
1 

1             II  1 

1           1       1     HS  1 

1    1  HS 

1  1 
1  1 

1     AAT  1 

1     AAT  1 

1 

1             •  10902 

1 
1 
1 

531 

510 


ERIC 


Table  A. 9  (cont'd) 


OBSERVES 


HS 


Teachers 


•  10903 

•  13504 


AAT 


•  10902 


Aides 


511 


53 


2 


ERIC 


Table  A. 9  (cont'd) 


MANAGEMENT  BEHAVIOR 


.35 
.33 
.31 
.29 
.27 
.25 
.23 
.21 
.19 
.17 
.15 
.13 
.11 
.09 
.07 
.05 
.03 
.01 


Teachers 


•  11501 


MA 


Aides 


512 


ERIC 


Table  A. 9  (cont'd) 


)5 


14 


HS 


SOCIAL  INTERACTT ON 


Teachers 


hA 


Aides 


•  11503 


AAT 


534 


ERIC 


Table  A. 10 


DIFFERENCgS   IN  CAREGIVER  BEHAVIORS  BY  LEVEL  OF  EDUCATION  AND  JOB  ROLE 


MA'S 

/  n  —  O  > 

(n-8 ) 

AAT 
(n= 

•s 
11) 

HS*s 
(n=ll) 

Teachers 

Mean  S.D. 

1  Mean 

S.D.  1 

Mean 

S.D.  1 

F 

Sig. 

Social 
inceracc ion 

11  r\'^ 

.21           ,0  / 

1 

1  .23 

1 

.06  1 

.  17 

1 

.07  1 

2.26 

.12 

Management 

Dc  IldV  1  O  L 

mil.                      .  Ub 

1      . 17 

.05  1 

.  15 

.04  1 

2.31 

.12 

Instructs 

.08  .04 

1  .09 

.04  1 

.06 

.04  1 

1.09 

.35 

Adult 
Activity 

.04  .04 

1  .04 

.05  1 

.06 

,04  1 

.39 

.68 

Activity 

.46  .12 

1  .35 

.10  1 

.34 

.10  1 

3.21 

.06 

Observes 

.17  .10 

1  .20 

.11  1 

.28 

.07  1 

3.17 

.06 

Aides 

1  (n= 

11)  1 

(n=ll) 

Soc  lal 
Interact  ion 

1  .22 

.07  1 

.16 

.12  1 

1.97 

.16 

Management 
Behav  ior 

1  .17 

.06  1 

.13 

.06  1 

2.87 

.07 

Instructs 

1  .08 

.06  1 

.08 

.08  1 

.01 

.99 

Adult 
Activity 

1  .04 

.06  1 

.05 

.06  1 

.05 

.95 

Center 
Activity 

1  .28 

.10  1 

.33 

.16  1 

.65 

.53 

Observes 

j  .29 

.09  1 

53o 

.34 

.19  1 

.69 

.51 

ERIC 


PEARSOM  COmLATIOMS  FOR  ADULT  FOCUS  VARTABttS  «v  LEVEL  OF  EDUCATrnN  AND  JOB  ..OLrs 

Activity  Jb»Tva 


Initructi 


Adult 
Activity 


Croup  Sizm 
^•Mch9tM  (n-30) 
HA  (n-8) 


h«n«9M«nt 

Bthavlor 


AAT 

(n-11) 

-  .43 

HS 

(n-11) 

.40 

AidM 

(n-22) 

-  .54** 

AAT 

(n-11) 

HS 

(n-11) 

-  .82»» 

MuwbT  of  rartqivrs 
T««ch«r»" (n-36) 


lA  (n-8) 

AAT  (n-11) 

HS  (n-11) 

Ald«s  (n-22) 

AAT  (n-11) 

HS  (n-11) 


-  .59 

-  .42 
.38 


.40 


.69* 
.60 


.44* 
.59* 
.40 


.59* 


.31 


-  .4* 


.  J8* 
•  i7* 


.40* 
.54* 

.67** 
.82** 


.38 


.35 

.48* 

.b8* 


.48** 

.65* 


Social 
Infraction 


-  .22 

-  .67* 


-  •75** 

-  .36 

-  ,84** 


-  .30* 
•  .66* 

-  .71*« 


StJff/Child  Ratio 
Taactitra  (n-3(5j" 
«A  (n-8) 
AAT  (n-11) 
HS  (n-11) 

Aidas  (n-22) 
AAT  (n-11) 
HS  (n-ll) 


-  .57 


.31 
.43 
.79* 


.32* 
.55 


.48* 
.42 

.51 


.38* 


.59* 


.37* 
.65* 


.50 

.41* 

.74* 


.48 
.66* 


•  48 


.44* 


Education  Laval 
Taachars  (n-3fl) 


.20 


Aidas 


(n-22) 


.40* 


-  .44** 


.19 
.35* 


.26 
.30 


Total 

Day  Cara  Exparianca 

Taachars  (n-3(5)  

I^A  (n-8) 
AAT  (n-:i) 
hS  (n-11) 

Aidas  (n-22) 
AAT  (n-10) 
HS  (n-11) 


26 


.48 
.34 


P<.05 
P<.Oi 


.46 


.37 
.31 


.29 
.48 


.42 

.50** 

.41 

.64** 


.57* 


?ravious 

^ay  Cara  Expariance 
xaacnars  (n-i3)   .19 

MA  (n-8) 

AAT  (n-ll) 

HS  (n-lO) 

Aidas  (n-21) 
AAT  (n-10) 
HS  (n-ll) 


antar  Exparianca 
Taacftars  (n«i$)  .19 

MA  (n-8) 

AAT  (n-li) 

HS  (n-10) 

Mdas  (n«21) 
AAT  (n-10) 

HS     (n-ll)  -  .34 


.48 


.39 
.49 


.53 
.55* 


.42 


-  .35 


.45* 

.38 

.67** 


irrelationa  ara  raportad  for  p<.i5  only. 


515 


536 


.31 
.45 


.32* 
.39 


.27 
.44 


Table  A. 12 

POLICY  VARIABLE/CHILD  FOCUS  REGRESSION  RESULTS 


(N-30) 

Dependent  Variable 

Independent  Variable 

r 

B 

F 

^F 

Monitors  Environment 

Group  Size 

.47 

.004 

.001 

7.90 

.01 

.22 

rrevious  uciy  L>ar e 
Experience 

— .  Jj 

— .  U  lo 

n  n  A 

3 .  B  J 

.06 

•  12 

Previous  Day  Care 

pvnprienr*p 

Staff/Child  Ratio 

-.35 
-.21 

-.024 
-.525 

.009 

.251 

7.11 
4.37 

.01 
.05 

.24 

Wanders 

P  r  PIT  1  mi  c   Da  M  Para 

Experience 

n  n  Q 

n  1 

.27 

Gives  Opinions 

Group  Size 

-.38 

-.002 

.001 

4.85 

.04 

.15 

Center  Experience 

-.37 

-.006 

.003 

4.46 

.04 

.14 

Gives  Orders 

Center  Experience 

.34 

.001 

.001 

3.55 

.07 

.11 

Receives  Orders 

Center  Experience 

-.38 

-.004 

.002 

4.68 

.04 

.14 

Receives  Info,  Help 

Group  Size 

-.72 

-.004 

.001 

29.89 

.01 

.52 

Number  of  Caregivers 

-.49 

-.020 

.007 

9.06 

.01 

.24 

Number  of  Caregivers 
Staff/Child  Ratio 

-.49 
.08 

-.023 
.318 

.007 
.160 

13.68 
3.93 

.01 
.06 

.34 

Receives  General 

Center  Experience 

-.46 

-.005 

.002 

7.34 

.01 

.21 

Part.  In  Open  Activity 

Center  Experience 

.55 

.023 

.007 

12.40 

.01 

.31 

Center  Experience 
Group  Size 

.55 
.45 

.019 
.0034 

.0067 
.0017 

8.39 
3.79 

.01 
.06 

.39 

Part.  In  Structured 
Activity 

Group  Size               S  3  # 

-.38 

-.006 

.003 

4.72 

.04 

.14 

ERIC 


Table  A. 13 


POLICY  VARIABLES/CHILtf  FnrM«  D..nc.^T"H 
'I'EACHER-DIRECTEU  ACTTVTTTpo  - 
(N-30)  — 


RESULTS 


Dependent  Variable  Independent  Variable 


Monitors  Environment 


Wanders 


^^pives  Opinions 
Gives  Orders 
Receives  Orders 


Receives  Info,  Help 


Receives  General 
Part.  In  Open  ActivJ^ty 


Part.  In  Structured 
Activity 


Group  Size 

Nunber  of  Caregivers 
Group  Size 

Number  of  Caregivers 

Group  Size 
Staff/Child  Ratio 

Group  size 

Group  Size 

Previous  Day  Care 
Experience 

Previous  Day  Care 

Experience 
Level  of  Education 

Previous  Day  Care 
Experience 

Previous  Day  Care 

Experience 
Group  Size 

Center  £xperience 

Previous  Day  Care 
Experience 


Group  size 


.44 

.004 

.'40 

-.024 

.46 

003 

.40 

.020 

.46 

.004 

.19 

.356 

.32 

-.002 

.32 

.002 

.33 

.006 

.001 
.011 
.001 
.009 


6.80 
5.18 
7.33 
5.19 


.001  10.01 

.193  3.40 

.001  3.12 

.001  3.20 

.003  3.49 


.01 

.03 

.01 

.03 

.01 
.08 

.09 

.08 

.07 


.20 
.16 
.21 
.16 
.30 

.10 
.10 
.11 


538 


.33 

.006 

.003 

4.41 

.05 

.21 

-.29 

-.006 

.003 

3.45 

.07 

.53 

.035 

^10 

11.15 

.01 

.28 

.53 

-.027 

.010 

7.06 

.01 

.42 

.52 

-.004 

.002 

6.36 

.02 

-.31 

-.003 

.002 

2.96 

.10 

.10 

-.35 

-.014 

.007 

3.89 

.06 

.12 

-.41 

-.009 

.004 

5.  70 

.02 

.17 

ERIC 


Table  A. 14 

POLICY  VARIABLES/CHILD  FOCUS  REGRESSION  RESULTS 
FREE-PLAY  SITUATIONS 


Dependent  Variable 

Independent  Variable 

r 

B 

^F 

r2 

Monitors  Environment 

Group  Size 

.31 

.003 

.002 

2.94 

.10 

.10 

Previous  Day  Care 
Experience 

-.30 

-.016 

.010 

2.75 

.11 

.09 

Wanders 

Level  of  Education 

-.35 

-.015 

.007 

4.02 

.05 

.13 

Gives  Opinions 

Number  of  Caregivers 

-.40 

-.019 

.008 

5.34 

.03 

.16 

Number  of  Caregivers 
Center  Experience 

-.40 
-.38 

-.016 
.008 

.008 
.004 

3.94 
3.34 

.06 
.08 

.25 

Gives  Orders 

Center  Experience 

.29 

.002 

.001 

2.56 

.12 

.08 

Receives  Orders 

Group  Size 

-.47 

.002 

.001 

8.24 

.01 

.23 

Center  Experience 

-.35 

.005 

.002 

3.90 

.06 

.12 

Receives  Info,  Help 

Group  Size 

-.32 

-.001 

.001 

3.12 

.09 

.10 

Receives  General 

Center  Experience 

-.41 

-.006 

.002 

5.67 

.02 

.17 

Part.  In  Open  Activity. 

Center  Experience 

.55 

.043 

.012 

12.44 

.01 

.31 

Part.  In  Structured 
Activity 

Center  Experience 

-.38 

-.028 

.013 

4.85 

.04 

.15 

ERIC 


T«blt  A. 15 


Dependent  variabl* 

Maintains  sat* 
ClattrooB 

Haintaint  sanitary 
Classroojp 


Provid««  Grota  Hotor 
Toya 

Providvs  crvativ* 
Play  Hat. 

Arrangaa  Classroor. 


Encouragat  Safaty 

Managvt  class  Activi- 
ti»s  Wall 


Encourages  Activa  play 


Encouragas  Cog/Lang. 
Davalop. 

Encourages  Good  Self- 
Concept 


Encourages  Self-Help 


Encourages  Social 
Behavior 

Constructs 

Physical  Environnent 


Resources 


Clasarooffl  Managenent 


Child  Orientation 


COA  Rating 


POLICY  VARIABLE/CDA  RBCRESSlOk  REKUfTc 

R 

Policy  Variable  r 

E 

Staff/Child  Ratio 

.30 

.849 

.512 

2.75 

.11 

.09 

Staff/Child  Ratio 

.39 

.665 

.308 

4.95 

.03 

.15 

Staff/Child  Ratio 
Previous  Day  Care 
Experience 

.39 
.3? 

.706 
.024 

.286 
.010 

6.10 
5.41 

.02 
.03 

.30 

Previous  Day  care 

Experience 

.50 

.066 

.022 

9.17 

.005 

.25 

*t«*i/^niia  Ratio 

•  49 

2.482 

.847 

8. 59 

.24 

Previous  Day  care 

Experience 

.43 

.099 

.040 

6.03 

.02 

.18 

Previous  Day  carc 
Experience 

.43 

.101 

.037 

7.33 

.01 

.32 

Stsff/Child  Ratio 

.49 

2.  332 

1.027 

5.16 

.03 

L«vel  of  Education 

.32 

"  Ti04 

•  059 

3.09 

.09 

.10 

Previous  Day  care 

Experience 

.58 

.077 

.021 

13.56 

.001 

.33 

Previous  Day  Care 
Experience 

.58 

.085 

.019 

20.31 

.00 

•  49 

Level  of  Education 

.33 

.090 

.032 

7.89 

.009 

Previous  Day  care 

Experience 

.62 

.104 

.025 

16.86 

.001 

.38 

Group  Size 

-.56 

-.030 

.008 

12.30 

.002 

.31 

Previous  Day  Care 

Experience 

.46 

.059 

.022 

7.27 

.01 

21 

Previous  Day  Care 
Experience 

.46 

.060 

.020 

8.63 

.007 

.33 

Staff/Child  Ratio 

.33 

1.209 

.560 

4.66 

.04 

Center  Experience 

.31 

.027 

.016 

2. 96 

.09 

.10 

Center  Experience 

Staff/Child  Ratio 

.31 
.26 

.029 
1.026 

.015 
.656 

3.51 

.07 
.13 

.18 

Center  Experience 

Staff/Child  Ratio 
Level  of  Education 

.31 
.26 
-.20 

.032 
1.  432 
—  .079 

.015 
.660 

4.72 
4.75 
3.81 

.04 
.06 

•  29 

Previous  Day  csrc 

Experience 

.54 

.111 

.033 

.002 

.30 

Staff/Child  Ratio 

.45 

.748 

.287 

6.80 

.  01 

.20 

Previous  Day  Care 

Experience 

.41 

.062 

.027 

5.36 

.CJ3 

.17 

Previous  Day  care 
Experience 

.41 

.064 

.024 

6.84 

.01 

.33 

Staff/Child  Ratio 

.40 

1.701 

.669 

6.46 

.02 

Previous  Day  Care 

Experience 

.51 

.068 

.022 

9.37 

.05 

.26 

Previous  Day  Care 
Experience 

.51 

.076 

•020  14.66 

.001 

.43 

Level  of  Education 

.36 

.096 

.034 

8.03 

.009 

Previous  Day  Cart 
Expert  ence 

.48 

.064 

.023 

8.10 

.008 

.23 

Previous  Dey  Carc 
Experience 

Staff/Child  Ratio 

Previous  Day  Carc 
Experi  ence 

Previous  Day  care 
Experience 

Staff/Child  Ratio 


•48  .066 
•39  1.512 
•52  .056 


.52 
.43 


.057 
1.320 


.020  10.52 

•559  7.32 

.018  9.87 

•015  13.77 

.422  9.77 


.003 

.01 

.004 

.001 
.004 


.27 
.47 


519 


540 


Table  A. 16 


PEARSON  CORRELATIONS  FOR  ADULT  FOCUS  AND  CHILD  FOCUS  VARIABLES 
TEACHERS — TEACHER-DIRECTED  AND  FREE-PLAY  COMBINED 


Instructs 

Adult 
Activity 

Center 
Activity 

Observes 

Manag ement 
Behavior 

Social 
Interactior 

Monitors  Env.  (n"30) 
MA  (n«8) 
AAT  (n«ll) 
No n- A AT  (n«ll) 

.24 
.90** 

-.38 

.20 
.43 

-.62* 
.35 

-.27 
-.36 

Part.  In  Group-Open 
MA 
AAT 

Non-AAT 

.49 
-.60* 

.53 

.37 

-.53 

Part.  In  Group-Closed 
MA 
AAT 

Non-AAT 

.44 

-.21 
-.70* 

-.68* 

.65* 

.20 
.45 

.40 

Does  Nothing;  Wanders 
MA 
AAT 

Non-AAT 

*■  -.51 

.70* 

;  .68* 

.24 

-.59 

-.38* 
-.73* 

-.47 

Gives  Opinions 
MA 
AAT 

Non-AAT 

.27 
.65* 

.42** 
-.44 
.69** 
.40 

-.21 
-.62* 

-.41 

.64* 
% 

.31* 
•  55 
.52* 

Gives  Orders 
MA 
AAT 

Non-AAT 

.65* 

.29 
.42 

.46 

-.19 

-.28 
-.  64* 

-.52* 

-.39 

Receives  Orders 
MA 
AAT 

Non-AAT 

.44 

-.85** 
.41 

-.25 
-.49 

.78** 
-.34 

.72* 

Receives  In£o,  Help 
MA 
AAT 

Non-AAT 

.24 

-.24 
-.47 

.26 
.57* 

.37* 

.50 
.34 

Receives  General 
MA 
AAT 

Non-AAT 

-.48 

.25 
.65** 

-.22 
-.35 

-.47 
.44 

*  p<.05 
**  p<.01 

Correlations  are  reported  for  p<.15  only. 


520 


Table  A. 17 

PEARSON  CORRELATIONS  FOR  ADULT  FOCUS  ANn  r«T,n  ^qCVS  VARIABLES 
AiUES-TEACHER-UiHECTED  ANn  FREE-PLAY  CQMBTNRn  "^^'-" 

in^iiucts    A^Sk  Observers    "1^^  xnlL^jc'^ion 

-.27 


Does  Nothing; 
AAT 

Non-AAT 


Wanders 


Monitors  Env.  (n«22) 
(n-ll) 

Non-AAT  (n-ll)  -.49 


Part.  In  Group-open  -.29 
AAT 

Non-AAT  49 

Part.  In  Group-Closed  .43* 
AAT 

Non-AAT  .7i«« 


.30 
.36 


.72** 
.79 
.67** 


.26 


.44* 
.71 


.25 
.38 

.37* 
.48 


-.43 


-.23 


-.66** 
-.65 
-.55* 


.45* 
.41 

.36 


-.25 


-.57 
-.61 
-.53* 


-.53** 
-.57* 


.70** 
.68 
.81** 


-.24 
.43 


^ives  Opinions 
AAT 

Non-AAT 


lives  Orders 
AAT 

Non-AAY 


-.42 


.54 

.39 


-.47 


.26 
.34 
.38 


.53** 

.46 

.51* 


teceives  orders 
AAT 

Non-AAT 


eceives  info.  Help 
AAT 

Non-AAT 


eceives  General 
AAT 

Non-AAT 


-.42*- 
-.70** 


.40* 

.46 

-.59 


-.69** 

-.78 

-.64* 


.36 
.50 


P<.05 
*  p<.01 

>rrelations  are  reported  for  p<.15  only. 


.32 
.44 

.24 

.49 


.39* 
.62* 


.40* 
.53* 


.38 


.42 


.25 
.39 


.41* 

.41 

.48 
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Table  A. 18 


PEARSON  CORRELATIONS  ^gg  ADULT  FOCUS  j^D  CHILD  FOCUS  VARIABLES 
TEACHERS — TEACHER-DIRECTED  ACTIVitTes 


Instructs 

Adult 
Activity 

Center 
Activity 

Observers 

Ma nag enent 
Behavior 

Social 
Interact 

Monitors  Env.  (n«30) 
MA  (n»8) 
AAT  (n«ll) 
Non-AAT  (n-11) 

.31* 
.81** 

.40 

-.19 
-.65* 

-.37* 

-.39 
-.44 

Part.  In  Group-Open 
MA 
AAT 

No  n- A  AT 

-.31* 
-.44 

.38 
.34 

-.39* 
-.45 

-.50 

.41** 
.76** 
.51* 
.38 

.28 
.61 
-.38 

Part.  In  Group-Closed 
MA 
AAT 

No n- A AT 

.40 

-.37* 

-.60 

-.38 

.42 

.35 

Does  Nothing;  wanders 
MA 
AAT 

Non-AAT 

.81** 

.44 

.19 

-.61 
-.36 

-.31* 
-.69* 

-.39 

Gives  Opinions 
MA 
AAT 

Mo  n- A  AT 

.37* 

.52* 
.45 

-.54* 

-.44 
-.59* 

.52* 
-.52* 

Gives  Orders 
MA 
AAT 

Non-AAT 

.67* 
-.39 

.23 
.36 

-.27 

.40 
-.78** 

-.46 

Receives  Orders 
MA 
AAT 

Non-AAT 

.42 
.39 

-.46 

-.67* 
.62* 

.67* 
-.44 

.60 

Receives  Info,  Help 
MA 
AAT 

Non-AAT 

-.37* 
-.49 

-.44 

-.21 

.26 

.31* 
.42 

Receives  General 
MA 
AAT 

Non-AAT 

-.67** 

.60* 
.35 

.35 
-.48 

*  p<.05 
**  p<.01 

Correlations  are  reported  for  p<.15  only. 
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Table  A. 19 


•  PEARSON  CORRELATIONS 

FOR  ADULT  FOCUS  AND  CHILD  pnrii«5 

VARIABLES 

Monitors  Env,  (n«22) 
AAT  (n-11) 
Non-AAT  (n-11) 

•  *fi.n^»ntn-uj.nti.i6u  ACTIVITIES 

instructs                      .llT^H,      Observers  T.tlTiT 

.29 
.57. 

Social 
Interact!* 

-.53** 
— .  64* 
-!61* 

Part.  In  Group-Open 
AAT 

Non-AAT 

.72** 

-.30 
-.47 

-.23 
-.48 

.54** 
.77** 

-33 
.75** 

Part.  In  Group-Closed 
AAT 

Non-AAT 

.59** 

.63* 

.63* 

-.34 
-.36 

-.33 

-.  52* 

-.61* 

.35 
.48 

.72** 
.  83*  * 
'72** 

Does  Nothing;  Wanders 
AAT 

Non-AAT 

-.35 
37 
-.35 

.78** 
.82** 
.78** 

.28 
.47 

-.35 
-.51* 

-.36* 
-.39 

Gives  Opinions 
AAT 

Non-AAT 

.35 

.32 
-.45 
.64* 

-.46 

Gives  Oracrs 
AAT 

No  n-AAT 

-.36 

.39 

-.25 
—  .45 

Receives  Orders 
AAT 

No  n-AAT 

37 

-.44  .41 

Receives  Info,  Help 
AAT 

Non-AAT 

-. 58** 
-.71** 
-.58* 

.59**  -.32 
•71**  -.52* 

.41 

Receives  General 
AAT 

Non-AAT 

56* 

.34 
.68** 

.42 
-.49 

.38 

-.41 

*  p<.05 
**  p<.01 

Correlations  are  reported 

for  p<, 

.15  only. 

c 
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Table  A. 20 


PEARSON  CORRELATIONS 

FOR  ADULT  FOCUS  AND  CHILD 

FOCUS  VARIABLES 

TEACHERS— FREE 

PLAY 

Adult 
Instructs  Activity 

Center 
Activity 

Management 
Observers  Behavior 

Social 
Interaction 

Monitors  Env.  (n"30) 
MA  (n"8) 
AAT  (n-11) 
Won- AAT  (n-11) 

.24 
.83** 

-.23 
-.68** 

.21 

-.56 

Part.  In  Group-Open 
MA 
AAT 

No  n- AAT 

-.46 

-.21 
-.68** 

.65* 

.42 

-.47 

-.19 
-.60 
-.38 

Part.  In  Group-Closed 
MA 
AAT 

No n- AAT 

.34 

-.62* 
.46 

-.81** 

.43 
-.41 

.76** 

-.43 

.60* 

.54 

Oo«s  Nothing;  Wanders 
MA 
AAT 

No n- A AT 

-.80** 
.40 

.59* 

.56 

-.33* 
-.44 

Gives  Opinions 
MA 
AAT 

No n- A AT 

.42 

.73** 

-.28 
-.54 

-.35 

.22 
.72* 

.43 

.33* 

.50 

.58* 

Gives  orders 
MA 
AAT 

No  n- A  AT 

.55 

.27 
.43 

.42 

-.23 
-.72* 

-.38 

Receives  Orders 
MA 
AAT 

No n- AAT 

.22 
.47 

.25 
-.59 
.38 
.36 

-.21 
-.43 

.44 

.50 
.50 

Receives  Info,  Help 
MA 
AAT 

No n- AAT 

.35* 
.47 

•  54* 

.40 

-.37 

.32* 

.48 

.45 

Receives  General 
MA 
AAT 

No n- AAT 

-.35 

.27 
.65** 

-.36* 
-.80** 

-.36 

.21 
.85** 

.60* 

*  p<.05 
**  p<.01 

Correlations  are  reported  for  p<.15  only. 
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Table  A. 21 


Monitors  Envr.  (n«22) 
AAT  (n-11) 
Non-AAT  (n«ll) 


Adult 
Instructs  Activity 

.35 


Center 
Activity 

.24 
.42 


Management  Social 
Observers      Behavior  Interactio 

-.37* 
-.43 


Part.  In  Group-Open 
AAT 

Non-AAT 


Part.  In  Group-Closed 
AAT 

Mon-AAT 


Does  Nothing;  Wanders 
AAT 

Non-AAT 


-.28 
-.48 

.23 
.43 


.24 

.40 


.30 


.25 


.47** 
.64* 


.29 


-.69** 
-.73** 
-.58* 


.41* 
.62* 


-.45* 
-.51 


.52** 

.52* 

.52* 


Gives  Opinions 
AAT 

Non-AAT 


-.38 


.39* 
.56* 


Gives  Orders 
AAT 

Non-AAT 


Receives  Orders 
AAT 

Non-AAT 


Receives  info,  Belp 
AAT 

Non-AAT 


Receives  General 
AAT 

Non-AAT 


p<.05 
**  p<.01 


.37 

.42* 

.50 

.38* 
.62* 

-.38 


-.43* 
-.81** 


-.38* 
-.60* 


.44* 
.56* 
.40 


-.27 


.36 

.34 
.39 


.43* 

.42 

.54* 


.59** 

.43 

.73** 


.74** 
.85** 
.61* 


.56 
.39 


.36* 
.38 

.33 
.57* 


Correlations  are  reported  for  p<.l5 


onlv. 
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Constructs 
Observes 

Observes 

Ln 

N)  Social 

^  Interaction 


-•32 

-•32 
-•08 


'8^242 


Table  A. 22 

ADULT  FOCUS/PSI  GAIN  SCORE  REGRESSION  RESULTS 


Teachers 
(N-29) 

se„  f> 


-7^624  4^372 


4^637 
7^263 


3.04 

1.29 


•  09 


.05 
.27 


•  10 

•  14 


Constructs 

Social 
interaction 

Social 

Interaction 
Adult  Activity 


se.. 


Aides 
(N-22) 


.49  10.181 
.48  -14.663 


5.165 
7.650 


.49      13.109      5^242  6.25 


3^90 
3^67 


•  02 

•  06 
.07 


.24 


.36 


Pol^  Vars^  t  Constructs 


Group  Size  -.37 

Staff/Child  «56 

Ratio 

Social  -.08 

Interaction 

Observes  -•32 


-•315  •OTl  19^69 
18^721     10^539  3.16 


-14^129 
-7.173 


5^361 
3.339 


6^94 
4^61 


*000 
•  08 


•  01 

•  04 


•  60 


Pol.  Vars^  k  Constructs 


Group  Size 
Staff/Child 

Ratio 
Social 

Interaction 
Observes 


-.66 
.59 


.49 


-.557 


•  198 


20^723  10^465 


-3.397  6^291 


7^95 
3.92 


.29 


5^622    3^473  2^62 


.01 
.06 


.60 
.12 


•  59 
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Table  A.  23 

ADULT.FUCUS/PSI  GAIN  ^rpRE  HfcGRLSSlOti  P...».c 


Constructs 

Management 
Beltavlnr 

hanagement 
betiavlor 

Adult 
Activity 

Negative 

Positive 


r 

B 

(N-29) 

F 

k2 

-.29 

-le.430 

11.765 

2.4b 

.13 

.08 

-.29 

-25.19 

13.71 

4.63 

.04 

.20 

24 

-30.31 

15.47 

3.B4 

.06 

-.36 
•32 

-61.18 
59.45 

44.05 
36.  24 

3.40 
2.69 

.07 
.11 

.21 

Constructs 

Previous  Day  .50 
Care  Experience 

hanagenent  -.29 
Behavior 

Adult  _,24 
Activity 


1.847 
-22.417 
21.049 


.696 
10.611 
14.379 


6.99 
4.46 
2. 14 


.0? 
.04 
.15 


Pr^lous  Day  .50 
care  Experience 

1.444 

.802 

3.24 

.08 

Group  Size 
Staf i/chiid 
Ratio 

-.23 
.07 

-.108 
-18.637 

.135 
20.497 

.64 
.64 

.56 
.63 

hanagement 
Behavior 

-.29 

-23.554 

10.^41 

4.72 

.04 

Adult 
Activity 

-.24 

-20.391 

15.167 

1.61 

.19 

.38 


.41 


Constructs 

Social 
Interaction 


Pol.  Vara,  t  Constructs 
.36 
.3C 


Previous  Day  Care 

Experience 
Social  Interaction 


Previous  Day  Care 

Experience 
Group  Size 
Staff/Child 

Ratio 
Social  Interaction 


.36 

-.19 
.01 


Aides 
7n^) 


.30      11.938      8.596  1.93 


1.752  .984 
12.195  8.145 

2.212  .  1.052 

.203  .325 
-22.429  20.977 

.30      22.899  12.818 


3.17 
2.24 

4.42 

.31 
1.14 

3.19 


.17 


.09 
.15 

.05 

.54 

.30 

.09 


.09 


.23 


.31 


5^8 
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Table  A. 24 


CHILD  FOCUS/COGNITIVE  GAIN  SCORE  REGRESSION  RESULTS 
COMBINATION  SITUATIONS 
(N=30) 


Dependent  Variable 

Independent  Variable 

r 

B 

F 

R^ 

PSI  Gain  Score 

Receives  Information 

.46 

33.890 

15.020 

5.09 

.03 

.15 

Receives  Informarion 
Gives  Opinions 

.46 
.19 

31.370 
29.096 

14.872 
20.685 

4.45 
1.98 

.04 

.17 

.21 

Group  Size 
Staff/Child  Ratio 
Receives  Orders 

-.38 
.57 
.10 

.314 
22.211 
"  30.078 

.076 
11.437 
30.742 

17.08 
3.77 
1.30 

.00056 

.060 

.26 

.48 

PPVT  Gain  Score 

Wanders 

-.49 

"  60.421 

19.925 

9.20 

.0053 

.25 

Wanders 
Gives  Orders 

-.49 
.28 

-  59.1^5 
253.100 

18.754 
117.517 

9.94 
4.64 

.0042 
.038 

.36 

Wanders 
Gives  Orders 
Structured  Activity 

-.49 
.28 
.50 

"  53.124 
334.098 
23.411 

16.740 
107.772 
8.071 

10.07 
9.61 
8.41 

.0041 
.0048 
.0074 

.51 

Previous  Day  Care  Experience 
Gives  Orders 
Structured  Activity 
Wanders 

.51 
.28 
.50 
-.49 

1.434 
324.477 
22.933 
-  33.754 

.678 
101.334 
7.584 
18.200 

4.47 
10.25 
9.14 
3.44 

.0042 
.0039 
.0058 
.072 

.59 

5iU 
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Table  a. 25 


Dependent  Variable 


PSI  Gain  Score 


ui 
to 
vo 


CHILD  ^OCUS/COGNITIVE  GAir  SCORE  REGRESSION  RESULTS 
TEACHfeR-DIR^.t,!)  AClTTVTTTpfc  

(N=3o)""  


Indeiend'^nt  Variable 


Gives  opinions 

Gives  Opinions 

Part,  in  Structured  Acr^i/ity 

Gives  Opinions 

Part,  in  Structured  Activ'ty 

Receives  Information 

Gives  Opinions 
Part,  in  Structured  Activity 
Receives  Information 
Receives  Orders 

Group  Size 
Staff/Child  Ratio 
Gives  Opinions 
Receives  Orders 


SEr, 


.57 

43.515 

15.018 

8.40 

.0072 

.23 

.57 
.25 

46.325 
8.545 

14.210 
4.008 

10.63 
4.55 

.003 
.04 

.34 

.57 
.25 
.26 

50.620 
7.223 
9.320 

14.280 
4.044 
6.578 

12.57 
3.19 
2.01 

.002 

.08 

.17 

.39 

.57 
.25 
.26 
.22 

49.756 
6.372 
13.403 
-49.572 

13.582 
3.870 
16.599 
25.555 

13.42 
2.71 
4.12 
3.76 

.001 
.11 
.05 
.06 

.47 

.30 
.067 
.57 
•  22 

-  .231 
21.^ 
24.900 

-36.712 

.071 
10.491 
12.666 
21.710 

10.71 
4.37 
3.86 
2.86 

.003 
.04 
.06 
.10 

•  58 

PPVT  Gain  Score 


Part,  in  Open  Activity 

-.34 

-50.661 

21.639 

5.48 

.02 

.16 

Part,  in  Open  Activity 
Wanders 

-.34 
-.36 

-43.y65 
-28.396 

21.404 
17.294 

4.22 
2.70 

.05 
.11 

.24 

Previous  Day  Care  Experience 
Structuied  Activity 

.55 
.44 

1.973 
10.616 

.745 
6.381 

7.03 
2.77 

.01 
.10 

.33 

Previous  Day  Care  Experience 
Wanders 

.51 
-.36 

1.993 
-16.983 

•  812 
18.094 

6.02 
0.88 

.02 
.64 

.28 
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Table  A. 26 


Dependent  Va  r  i  able 


PSI  Gain  Score 


PPVT  Gain  Scores 


m 
o 


CHILD  FOCUS/COGNITIVE  GAIN  SCORE  REGRESSION  RESULTS 
FREE-PLAY  SITUATIONS" 
(N=30)  • 


Independent  Variable 

r 

B 

F 

^F 

r2 

Receives  Orders 

.33 

52.708 

27.221 

3.75 

.06 

.12 

Receives  Orders 
Monitors  Environment 

.33 
-.21 

54.729 
-  14.633 

26.636 
9.615 

4.22 
2.32 

.05 
.14 

.19 

Group  gize 
Staff/Child  Ratio 
Gives  Orders 

.17 

.302 
22.874 
49.998 

.073 
11.491 
43.106 

16.99 
3.96 
1.35 

.001 

.05 

.25 

.48 

Gives  Orders 

.40 

204.645 

75.750 

7.30 

.01 

.21 

Gives  Orders 
Monitors  Environment 

.40 
-.42 

194.982 
-  30.878 

70.356 
13.085 

7.68 
5.57 

.01 
.024 

.34 

Gives  Orders 
Monitors  Environment 
Wanders 

.40 
-.42 
-.33 

175.000 
"  31.352 
"  37.326 

64.909 
11.981 
14.974 

7.27 
6.85 
6.21 

.012 
.014 
.018 

.47 

Gives  Orders 
Monitors  Environment 
Wanders 

Receives  Information 

.40 
-.42 
-.33 

.32 

167.870 

-  36.436 

-  30.836 
47.830 

61.892 
11.706 
14.647 
24.868 

7.36 
9.69 
4.43 
3.70 

.011 
.005 
.043 
.063 

.54 

Previous  Day  Care  Experience 
Gives  Orders 
Structured  Activity 

.51 
.40 
.33 

2.726 
233.987 
15.203 

.611 
59.301 
6.248 

19.93 
15.57 
5.92 

.003 
*008 

)2 

.57 

Previous  Day  Care  Experience 
Gives  Orders 
Monitors  Environment 
Receives  Information 

.51 
.40 
-.42 
•  32 

1.798 
187.937 
-  26.933 
49.009 

.609 
57.531 
11.483 
22.900 

8.72 
10.67 
5.50 
4.60 

.007 
.003 

•  026 

•  040 

.60 

ERIC 


Table  A. 27 


CDA/PSI  GAIN  SCORE  REGRRfifiTOK, 

(N»3a)  — — 


Independent  Variable 

B 

r 

F 

r2 

CDA  Rating 

.31 

4.736 

r 

2.713 

3.05 

-  OQ 

1  n 

Child  Orientation 

.19 

2.303 

2.199 

1.10 

30 

m  JKJ 

n  A 
.  U  4 

Encourages  Active  Play 

.17 

1.897 

2.058 

.85 

^3 
m  \IJ 

.03 

Encourages  Cog/Lang.  Dev. 

.26 

2.277 

1.574 

2.09 

.  lb 

.07 

Encourages  Good  Self-Concept 

.11 

1.379 

2.303 

.36 

.56 

.01 

Encourages  Self  Help 

.23 

2.968 

2.398 

1.53 

.22 

.05 

Encourages  Social  Behavior 

.00 

(Not  computable) 

Classroom  Management 

.28 

4.012 

2.567 

2.44 

.13 

.08 

Encourages  Safety 

.28 

2.537 

1.653 

2.36 

.13 

.08 

Manages  Class  Activities  Well 

.24 

3.509 

2.638 

1.77 

.19 

.06 

Resources 

.38 

4.298 

1.953 

4.84 

.03 

.15 

Provides  Gross  Motor  Materials 

.30 

4.128 

2.476 

2.78 

.10 

.09 

Provides  Creative  Play  Materials 

.30 

4.510 

1.574 

8.20 

.008 

.23 

Arranges  Classroom  Well 

.22 

.154 

1.30 

1.40 

.25 

.05 

Physical  Environment 

.03 

.744 

5.262 

.02 

.88 

.00 

Maintains  Safe'  Classroom 

-.01 

(Not  computable) 

Maintains  Sanitary  Classroom 

.05 

1.149 

4.754 

.06 

.80 

.00 

